00000001:02000400:1.0F:1788744013.587037:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788744034.085269:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788744036.191350:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 527 MB/s 00000001:01000000:2.0:1788744036.440965:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 631 MB/s 00000001:01000000:1.0:1788744036.690728:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3447 MB/s 00000020:02000000:1.0:1788744037.492177:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_44_g07a5b2c 00000400:02000000:1.0:1788744038.994680:0:3294:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.156@tcp [8/256/0/180] 00008000:02000000:2.0:1788744042.648277:0:3443:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788744093.597383:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788744104.475747:0:5817:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744104.475753:0:5817:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788744104.475883:0:5817:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005ae53881 00000080:02000400:2.0:1788744104.475894:0:5817:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788744104.481928:0:5817:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788744104.481943:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788744104.481985:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004c16feb8) 00000020:00000080:2.0:1788744104.482007:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788744104.517852:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788744104.518267:0:5817:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788744104.572697:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788744104.572739:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788744104.572758:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788744104.572810:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788744104.572836:0:5817:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788744104.578777:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788744104.578791:0:5817:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744104.578809:0:5817:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b94305 00000020:01000004:3.0:1788744104.578818:0:5817:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788744104.578823:0:5817:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788744104.578830:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005ae53881 from MGS 00000020:01000004:3.0:1788744104.578834:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788744104.578869:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009fdbfdeb) 00000020:00000080:3.0:1788744104.578883:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788744104.579006:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ae53881 from MGS, refs=2 00080000:01000000:3.0:1788744104.579012:0:5817:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744104.579018:0:5817:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b94313 00000100:00100000:3.0:1788744104.579158:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788744104.583963:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788744104.583993:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788744104.588888:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788744104.588901:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788744104.590029:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0F:1788744104.604516:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788744104.604543:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788744104.611755:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788744104.611768:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788744104.614826:0:5817:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788744104.614854:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788744104.616919:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744104.616923:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744104.616925:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744104.618003:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744104.618008:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744104.618010:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744104.619272:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788744104.625350:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788744104.865423:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2287 MB/s 00000001:01000000:0.0:1788744105.114829:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5171 MB/s 00000001:01000000:1.0:1788744105.369031:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 311 MB/s 00000001:01000000:3.0:1788744105.618592:0:5817:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 567 MB/s 00010000:00010000:0.0:1788744105.627119:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788744105.634629:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788744105.667266:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788744105.667286:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788744105.667288:0:5817:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788744105.671689:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788744105.671770:0:5817:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788744105.671840:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788744105.672401:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788744105.672452:0:5817:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788744105.672800:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744105.674372:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788744105.674380:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788744105.676389:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788744105.676401:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788744105.681030:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788744105.681054:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788744105.682093:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000100:00080000:2.0:1788744105.682109:0:5832:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1788744105.682120:0:5817:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.156@tcp' 00000020:01000004:3.0:1788744105.682122:0:5817:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788744105.682375:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.156@tcp (typ=mgc) 00000020:00000080:3.0:1788744105.682388:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.156@tcp (00000000cf53ece6) 00000020:00000080:3.0:1788744105.682409:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788744105.682505:0:5817:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000d0e9ecf7@MGC192.168.204.156@tcp: add connection 192.168.204.156@tcp at head 00010000:00010000:3.0:1788744105.682687:0:5817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.156@tcp-0 is initialized 00000040:01000000:3.0:1788744105.682693:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788744105.685529:0:5833:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788744105.685589:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.156@tcp (uuid 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18) 00000020:00000080:2.0:1788744105.685613:0:5817:0:(genops.c:1384:class_connect()) connect: client 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18, cookie 0x7cd2bfd5e1b94321 00000100:00080000:2.0:1788744105.685623:0:5817:0:(import.c:545:import_select_connection()) MGC192.168.204.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744105.685633:0:5817:0:(import.c:666:import_select_connection()) MGC192.168.204.156@tcp: import 00000000d0e9ecf7 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744105.685678:0:5817:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ff3baf55 x1875634068390016/t0(0) o250->MGC192.168.204.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744105.685698:0:5817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS 00000020:01000004:2.0:1788744105.685715:0:5817:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788744105.685720:0:5817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788744105.685733:0:5817:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008e48c990) 00000020:00000080:2.0:1788744105.685743:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788744105.697143:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3baf55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3309:1875634068390016:0@lo:250: 00000100:00100000:3.0:1788744105.697244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744105.697643:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390016 00000100:00100000:0.0:1788744105.697651:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390016 00000100:00100000:0.0:1788744105.697694:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744105.697700:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005a0dcdef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875634068390016:12345-0@lo:250: 00010000:00080000:0.0:1788744105.697737:0:5828:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1788744105.697775:0:5828:0:(genops.c:1384:class_connect()) connect: client 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18, cookie 0x7cd2bfd5e1b9432f 00000100:00080000:0.0:1788744105.698320:0:5828:0:(import.c:65:import_set_state_nolock()) 00000000315233f2 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744105.698412:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005a0dcdef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:3309:x1875634068390016:12345-0@lo:250: Request processed in 710us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744105.698421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744105.700422:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788744105.700439:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.156@tcp: connect to target with instance 0 00000100:00080000:3.0:1788744105.700447:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788744105.700452:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788744105.700455:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000d0e9ecf7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788744105.700459:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788744105.700470:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788744105.700475:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3baf55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3309:1875634068390016:0@lo:250: 00000100:00100000:2.0:1788744105.712691:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744105.713286:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744105.713294:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788744105.722740:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788744105.722759:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788744105.728328:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744105.728342:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788744105.729464:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744105.729745:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788744105.729751:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788744105.735984:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788744105.736002:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788744105.814032:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744105.814695:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788744105.814703:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788744105.816306:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788744105.816316:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788744105.817373:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744105.817538:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788744105.817544:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788744105.818768:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788744105.818776:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788744105.828292:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744105.828502:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788744105.828508:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788744105.829471:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788744105.829478:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788744105.830221:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744105.830394:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788744105.830400:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788744105.831077:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788744105.831085:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788744105.888351:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744105.888597:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744105.888604:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788744105.906850:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788744105.906870:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788744105.917654:0:5817:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744105.917673:0:5817:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788744105.920329:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788744105.920352:0:5817:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788744105.920358:0:5817:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788744105.920483:0:5817:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744105.920513:0:5817:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.156@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788744105.920517:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744105.920518:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744105.920520:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744105.920521:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744105.920522:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744105.920524:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744105.920525:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744105.920526:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744105.920528:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744105.920529:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744105.920530:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744105.920531:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744105.920533:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788744105.920535:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744105.920536:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744105.920537:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744105.920538:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744105.920539:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744105.920540:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744105.920541:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744105.920542:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744105.920543:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744105.920543:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744105.920544:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744105.920545:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744105.920618:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788744105.920635:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390144:0@lo:253: 00000100:00100000:1.0:1788744105.920714:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744105.920815:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df478a02 going to sleep for 11 seconds 00000100:00100000:0.0:1788744105.920924:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390144 00000100:00100000:0.0:1788744105.920933:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390144 00000100:00100000:0.0:1788744105.921023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744105.921039:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002487ca77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5817:x1875634068390144:12345-0@lo:253: 20000000:01000000:0.0:1788744105.921085:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744105.921088:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788744105.921515:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788744105.921591:0:5830:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788744105.921854:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744105.922885:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788744105.923082:0:5830:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744105.923086:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788744105.923091:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788744105.923094:0:5830:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788744105.923107:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788744105.923655:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744105.923879:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788744105.923894:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788744105.923942:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788744105.923987:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788744105.924024:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788744105.924364:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788744105.924373:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788744105.924419:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788744105.924427:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788744105.924459:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788744105.924466:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788744105.924493:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788744105.924536:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788744105.924828:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788744105.924835:0:5830:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788744105.924849:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744105.925051:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788744105.925136:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788744105.925261:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788744105.925298:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788744105.925342:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788744105.925361:0:5830:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788744105.925438:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788744105.925447:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788744105.925490:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788744105.925525:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788744105.925752:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788744105.925764:0:5830:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788744105.925845:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788744105.925854:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788744105.925885:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788744105.925919:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788744105.926231:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788744105.926282:0:5830:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788744105.926290:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788744105.926858:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788744105.927173:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788744105.927197:0:5830:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.156@tcp for mdt 20000000:01000000:0.0:1788744105.927199:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788744105.927234:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788744105.927241:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788744105.927269:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788744105.927276:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.156@tcp (null) (null) 00000040:00080000:0.0:1788744105.927335:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788744105.927348:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788744105.927382:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788744105.927415:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788744105.927469:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788744105.927473:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788744105.927477:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788744105.927489:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788744105.927491:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788744105.927519:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788744105.927526:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788744105.928490:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788744105.928790:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788744105.928832:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788744105.928893:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788744105.928907:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788744105.928909:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788744105.929407:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788744105.929728:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788744105.929771:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788744105.929808:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788744105.929820:0:5830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744105.929822:0:5830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788744105.929827:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788744105.929830:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788744105.929835:0:5830:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788744105.929841:0:5830:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788744105.930819:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788744105.931138:0:5830:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788744105.941512:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788744105.941595:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788744105.941671:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788744105.941692:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788744105.941713:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941731:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941740:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941745:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941769:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941775:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941781:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004edaf72a already unused, calling callback (000000009b682f5c) 00010000:00010000:0.0:1788744105.941785:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941792:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941804:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941812:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744105.941817:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004edaf72a/0x7cd2bfd5e1b94336 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744105.941835:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788744106.243775:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002487ca77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5817:x1875634068390144:12345-0@lo:253: Request processed in 322737us (323053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744106.243794:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744106.243921:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390144:0@lo:253: 10000000:01000000:1.0:1788744106.243936:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788744106.243945:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744106.243947:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744106.243948:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744106.243949:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788744106.243951:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744106.243952:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744106.243953:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744106.243954:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744106.243956:0:5817:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788744106.243957:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744106.243959:0:5817:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788744106.243974:0:5817:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005ae53881 from lustre-MDT0000 10000000:01000000:1.0:1788744106.243999:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788744106.244002:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788744106.244006:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff940ad0d43380 10000000:01000000:1.0:1788744106.244010:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744106.244018:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff940ad0d43380 from 1 10000000:01000000:1.0:1788744106.244020:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788744106.244070:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.244080:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.244088:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744106.244104:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390272:0@lo:101: 00000100:00100000:1.0:1788744106.244150:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.244222:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:2.0:1788744106.244456:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390272 00000100:00100000:2.0:1788744106.244463:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390272 00000100:00100000:2.0:1788744106.244503:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744106.244510:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3b2591a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5817:x1875634068390272:12345-0@lo:101: 00010000:00010000:2.0:1788744106.244523:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744106.244535:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9433d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.244593:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.244603:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.244611:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000586c9254, rc 0) 00000100:00100000:2.0:1788744106.244640:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3b2591a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5817:x1875634068390272:12345-0@lo:101: Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744106.244646:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744106.244820:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390272:0@lo:101: 00010000:00010000:1.0:1788744106.244833:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.244851:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744106.244895:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390400:0@lo:501: 00000100:00100000:1.0:1788744106.244918:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.244943:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:3.0:1788744106.244992:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390400 00000100:00100000:3.0:1788744106.244996:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390400 00000100:00100000:3.0:1788744106.245023:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744106.245039:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc92a5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5817:x1875634068390400:12345-0@lo:501: 00000100:00100000:3.0:1788744106.245470:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc92a5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5817:x1875634068390400:12345-0@lo:501: Request processed in 432us (551us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744106.245478:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744106.245603:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390400:0@lo:501: 10000000:01000000:1.0:1788744106.245631:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788744106.245649:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.245658:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744106.245666:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff940ac7f4d800 10000000:01000000:1.0:1788744106.245672:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788744106.245676:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff940ac7f4d800 10000000:01000000:1.0:1788744106.245678:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788744106.245680:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff940ac7f4d800 from 1 10000000:01000000:1.0:1788744106.245682:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788744106.245700:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.245706:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.245712:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744106.245734:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390528:0@lo:101: 00000100:00100000:1.0:1788744106.245761:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.245792:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:2.0:1788744106.245845:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390528 00000100:00100000:2.0:1788744106.245851:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390528 00000100:00100000:2.0:1788744106.245882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744106.245888:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000631bf746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5817:x1875634068390528:12345-0@lo:101: 00010000:00010000:2.0:1788744106.245904:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744106.245914:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b342ec7/0x7cd2bfd5e1b94352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9434b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.245930:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b342ec7/0x7cd2bfd5e1b94352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9434b expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.245939:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b342ec7/0x7cd2bfd5e1b94352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9434b expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.245946:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b342ec7, rc 0) 00000100:00100000:2.0:1788744106.245973:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000631bf746 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+7:5817:x1875634068390528:12345-0@lo:101: Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744106.245979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744106.246603:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390528:0@lo:101: 00010000:00010000:1.0:1788744106.246615:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.246623:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744106.246635:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788744106.246649:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.246655:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 00000000e2d8dcda/0x7cd2bfd5e1b9434b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744106.246661:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788744106.246666:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744106.246670:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff940ac7f4d800 10000000:01000000:1.0:1788744106.246673:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788744106.246675:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788744106.246677:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788744106.246693:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.246700:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.246718:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744106.246729:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390656:0@lo:101: 00000100:00100000:1.0:1788744106.246758:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.246778:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:2.0:1788744106.246878:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390656 00000100:00100000:2.0:1788744106.246884:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390656 00000100:00100000:2.0:1788744106.246919:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744106.246925:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005ca7eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+7:5817:x1875634068390656:12345-0@lo:101: 00010000:00010000:2.0:1788744106.246933:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744106.246942:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94359 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.246957:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.246965:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744106.246972:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000265c331b, rc 0) 00000100:00100000:2.0:1788744106.247013:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005ca7eeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:5817:x1875634068390656:12345-0@lo:101: Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744106.247020:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744106.247192:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390656:0@lo:101: 00010000:00010000:1.0:1788744106.247202:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744106.247209:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744106.247259:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390784:0@lo:501: 00000100:00100000:1.0:1788744106.247457:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.247478:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:3.0:1788744106.247530:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390784 00000100:00100000:3.0:1788744106.247535:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390784 00000100:00100000:3.0:1788744106.247590:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744106.247596:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b426b36a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:5817:x1875634068390784:12345-0@lo:501: 00000100:00100000:3.0:1788744106.247792:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b426b36a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5817:x1875634068390784:12345-0@lo:501: Request processed in 196us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744106.247799:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744106.247870:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390784:0@lo:501: 00000100:00100000:1.0:1788744106.247896:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390912:0@lo:503: 00000100:00100000:1.0:1788744106.247933:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744106.247961:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000008c6f1e95 going to sleep for 11 seconds 00000100:00100000:3.0:1788744106.248011:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068390912 00000100:00100000:3.0:1788744106.248016:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068390912 00000100:00100000:3.0:1788744106.248058:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744106.248063:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fa22e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5817:x1875634068390912:12345-0@lo:503: 00000100:00100000:3.0:1788744106.248416:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fa22e03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5817:x1875634068390912:12345-0@lo:503: Request processed in 352us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744106.248423:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744106.248501:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068390912:0@lo:503: 00000100:00100000:2.0:1788744106.248865:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5859:1875634068391040:0@lo:502: 00000100:00100000:2.0:1788744106.248904:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744106.248931:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f773ee82 going to sleep for 11 seconds 00000100:00100000:3.0:1788744106.248978:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391040 00000100:00100000:3.0:1788744106.248983:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391040 00000100:00100000:3.0:1788744106.249012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744106.249018:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6096366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5859:x1875634068391040:12345-0@lo:502: 00000100:00100000:3.0:1788744106.249411:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6096366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5859:x1875634068391040:12345-0@lo:502: Request processed in 393us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744106.249426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744106.249806:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5859:1875634068391040:0@lo:502: 00000020:01000000:1.0:1788744106.249903:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744106.249913:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744106.249915:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744106.249920:0:5859:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788744106.249929:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744106.249952:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009fb197e1) 00000020:00000080:1.0:1788744106.249971:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788744106.249977:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788744106.250121:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788744106.250131:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b9436e 00000020:00000080:1.0:1788744106.250673:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788744106.250679:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744106.250683:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744106.250684:0:5859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788744106.250687:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744106.250690:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744106.250692:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788744106.250695:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744106.250702:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bb6302ae) 00000020:00000080:1.0:1788744106.250712:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788744106.250716:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788744106.250718:0:5859:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788744106.250721:0:5859:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788744106.250727:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788744106.250769:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ae53881 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788744106.250780:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fc07b1f2) 00000020:00000080:1.0:1788744106.250787:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788744106.250843:0:5859:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788744106.250849:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b94383 00000020:00000080:1.0:1788744106.250942:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788744106.250950:0:5859:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788744106.250954:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7cd2bfd5e1b9438a 00080000:01000000:1.0:1788744106.250959:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788744106.250962:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b94391 00080000:10000000:1.0:1788744106.254701:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788744106.255008:0:5859:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788744106.275927:0:5859:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788744106.441741:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788744106.452142:0:5859:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788744106.471336:0:5859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788744106.471654:0:5859:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788744106.553398:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000092af8787) 00000020:00000080:1.0:1788744106.553424:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788744106.553497:0:5859:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788744106.553504:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b9439f 00000020:00000080:1.0:1788744106.558868:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788744106.560263:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744106.613179:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1788744106.650820:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788744106.693041:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744106.849245:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744106.953630:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788744107.033661:0:5859:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788744107.153545:0:5859:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7cd2bfd5e1b943a6 00000020:00000080:2.0:1788744107.157854:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788744107.157868:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744107.157874:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744107.157877:0:5859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788744107.157880:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744107.157884:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744107.157885:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744107.157887:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744107.157889:0:5859:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788744107.157891:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744107.157893:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744107.157895:0:5859:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788744107.157897:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744107.157901:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744107.157902:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788744107.157906:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788744107.157941:0:5859:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788744107.158000:0:5859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5859:1875634068391168:0@lo:502: 00000100:00100000:2.0:1788744107.158789:0:5859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744107.158854:0:5859:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe647969 going to sleep for 11 seconds 00000100:00100000:0.0:1788744107.158941:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391168 00000100:00100000:0.0:1788744107.158949:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391168 00000100:00100000:0.0:1788744107.158994:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744107.159002:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4a4b532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5859:x1875634068391168:12345-0@lo:502: 00000100:00100000:0.0:1788744107.159687:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4a4b532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5859:x1875634068391168:12345-0@lo:502: Request processed in 685us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744107.159695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744107.159815:0:5859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5859:1875634068391168:0@lo:502: 00000020:01000000:2.0:1788744107.159854:0:5859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744107.159860:0:5859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744107.159862:0:5859:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788744107.159866:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788744107.160315:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788744107.160416:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788744107.160439:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744107.160451:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744107.160459:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac7f4d800 from 1 10000000:01000000:0.0:1788744107.160462:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744107.160511:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744107.160519:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744107.160528:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744107.160545:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff299632 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391296:0@lo:101: 00000100:00100000:0.0:1788744107.160615:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744107.160644:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b66da31 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.162151:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391296 00000100:00100000:3.0:1788744107.162176:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391296 00000100:00100000:3.0:1788744107.162233:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744107.162242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e47dfe0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:5817:x1875634068391296:12345-0@lo:101: 00010000:00010000:3.0:1788744107.162257:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744107.162274:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b943ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.162300:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.162310:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.162318:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007011895d, rc 0) 00000100:00100000:3.0:1788744107.162395:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e47dfe0e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:5817:x1875634068391296:12345-0@lo:101: Request processed in 154us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.162402:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744107.162457:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff299632 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391296:0@lo:101: 00010000:00010000:3.0:1788744107.162471:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.162480:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744107.163096:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391424:0@lo:256: 00000100:00100000:3.0:1788744107.163141:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744107.163177:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000601bf196 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.163195:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391424 00000100:00100000:3.0:1788744107.163200:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391424 00000100:00100000:3.0:1788744107.163226:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744107.163232:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eae7f5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:5817:x1875634068391424:12345-0@lo:256: 20000000:01000000:3.0:1788744107.163248:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788744107.163254:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788744107.163319:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eae7f5f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:5817:x1875634068391424:12345-0@lo:256: Request processed in 88us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.163326:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744107.163359:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391424:0@lo:256: 10000000:01000000:3.0:1788744107.163967:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744107.163974:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.163984:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744107.163991:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac7f4d800 from 1 10000000:01000000:3.0:1788744107.163994:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744107.164030:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164037:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164057:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744107.164070:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391552:0@lo:101: 00000100:00100000:3.0:1788744107.164102:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744107.164126:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000601bf196 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.164144:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391552 00000100:00100000:3.0:1788744107.164148:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391552 00000100:00100000:3.0:1788744107.164174:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744107.164180:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8c3d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:5817:x1875634068391552:12345-0@lo:101: 00010000:00010000:3.0:1788744107.164188:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744107.164199:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b943bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164217:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164225:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164232:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec008012, rc 0) 00000100:00100000:3.0:1788744107.164261:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8c3d2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391552:12345-0@lo:101: Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.164266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744107.164300:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391552:0@lo:101: 00010000:00010000:3.0:1788744107.164310:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.164327:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744107.164371:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391680:0@lo:501: 00000100:00100000:3.0:1788744107.164395:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744107.164407:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000601bf196 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.164420:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391680 00000100:00100000:3.0:1788744107.164424:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391680 00000100:00100000:3.0:1788744107.164443:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744107.164447:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000fa0abbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391680:12345-0@lo:501: 00000100:00100000:3.0:1788744107.168931:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000fa0abbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391680:12345-0@lo:501: Request processed in 4475us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.168947:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744107.173140:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4b06047 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391680:0@lo:501: 00000100:00100000:0.0:1788744107.173436:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391808:0@lo:503: 00000100:00100000:0.0:1788744107.173516:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744107.173655:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391808 00000100:00100000:2.0:1788744107.173663:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391808 00000100:00100000:2.0:1788744107.173712:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744107.173720:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bfd22113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391808:12345-0@lo:503: 00000040:00080000:2.0:1788744107.173769:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744107.180723:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bfd22113 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391808:12345-0@lo:503: Request processed in 6994us (7198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744107.180739:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744107.181740:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ea9391f going to sleep for 11 seconds 00000100:00100000:0.0:1788744107.181773:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391808:0@lo:503: 00000040:00080000:0.0:1788744107.187103:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788744107.188049:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788744107.188074:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744107.188097:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.188111:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744107.188271:0:5817:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788744107.188274:0:5817:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff940ac7f4d800 10000000:01000000:1.0:1788744107.188278:0:5817:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff940ac7f4d800 10000000:01000000:1.0:1788744107.188282:0:5817:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788744107.188288:0:5817:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ac7f4d800 from 1 10000000:01000000:1.0:1788744107.188291:0:5817:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744107.188327:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.188336:0:5817:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.188421:0:5817:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744107.188458:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391936:0@lo:101: 00000100:00100000:1.0:1788744107.188522:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.188665:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a8d6519 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.188726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068391936 00000100:00100000:3.0:1788744107.188733:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068391936 00000100:00100000:3.0:1788744107.188784:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744107.188792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025d7c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068391936:12345-0@lo:101: 00010000:00010000:3.0:1788744107.188804:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744107.188825:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b943c9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.188849:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.188860:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744107.188881:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000029454b6, rc 0) 00000100:00100000:3.0:1788744107.188923:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025d7c02f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068391936:12345-0@lo:101: Request processed in 133us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.188930:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744107.189262:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068391936:0@lo:101: 00010000:00010000:1.0:1788744107.189275:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.189283:0:5817:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744107.189331:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392064:0@lo:501: 00000100:00100000:1.0:1788744107.189433:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.189455:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a8d6519 going to sleep for 11 seconds 00000100:00100000:3.0:1788744107.189509:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392064 00000100:00100000:3.0:1788744107.189514:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392064 00000100:00100000:3.0:1788744107.189630:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744107.189637:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3661b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068392064:12345-0@lo:501: 00000100:00100000:3.0:1788744107.189872:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3661b7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068392064:12345-0@lo:501: Request processed in 236us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744107.189879:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744107.189944:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392064:0@lo:501: 00000100:00100000:1.0:1788744107.189971:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392192:0@lo:503: 00000100:00100000:1.0:1788744107.190018:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.198379:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a8d6519 going to sleep for 11 seconds 00000100:00100000:0.0:1788744107.203044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392192 00000100:00100000:0.0:1788744107.203061:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392192 00000100:00100000:0.0:1788744107.203124:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744107.203134:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007827ecda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068392192:12345-0@lo:503: 00000100:00100000:0.0:1788744107.206004:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007827ecda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068392192:12345-0@lo:503: Request processed in 2863us (15987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744107.206030:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744107.206473:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392192:0@lo:503: 00000100:00100000:1.0:1788744107.206896:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5864:1875634068392320:0@lo:502: 00000100:00100000:1.0:1788744107.206961:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.207017:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de7ae1d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744107.207189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392320 00000100:00100000:0.0:1788744107.207197:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392320 00000100:00100000:0.0:1788744107.207241:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744107.207249:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000463ab5f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5864:x1875634068392320:12345-0@lo:502: 00000100:00100000:0.0:1788744107.207535:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000463ab5f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5864:x1875634068392320:12345-0@lo:502: Request processed in 285us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744107.207542:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744107.209112:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5864:1875634068392320:0@lo:502: 00000020:01000004:1.0:1788744107.209481:0:5864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788744107.209511:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005d8891e1) 00000020:00000080:1.0:1788744107.209536:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788744107.209649:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005ae53881 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788744107.209653:0:5864:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005ae53881 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788744107.209656:0:5864:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005ae53881 4 00010000:00080000:1.0:1788744107.209683:0:5864:0:(ldlm_lib.c:103:import_set_conn()) imp 0000000003c6fb44@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:1.0:1788744107.216691:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788744107.216976:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788744107.217025:0:5864:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744107.217039:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7cd2bfd5e1b943de 00000100:00080000:1.0:1788744107.217049:0:5864:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744107.217060:0:5864:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003c6fb44 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744107.217096:0:5864:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f8d15714 x1875634068392448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744107.217598:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068392448:0@lo:38: 00000100:00100000:3.0:1788744107.217667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788744107.217757:0:5864:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744107.218111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392448 00000100:00100000:0.0:1788744107.218119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392448 00000100:00100000:0.0:1788744107.218170:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744107.218176:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eaa50208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068392448:12345-0@lo:38: 00000100:00100000:0.0:1788744107.221821:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eaa50208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068392448:12345-0@lo:38: Request processed in 3636us (4146us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788744107.221995:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788744107.222004:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000003c6fb44 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788744107.222022:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788744107.222025:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f8d15714 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068392448:0@lo:38: 00000100:00100000:0.0:1788744107.222115:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744107.222232:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a94f3e07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5864:1875634068392576:0@lo:502: 00000100:00100000:1.0:1788744107.222311:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.222360:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d8d5178 going to sleep for 11 seconds 00000100:00100000:0.0:1788744107.227017:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392576 00000100:00100000:0.0:1788744107.227044:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392576 00000100:00100000:0.0:1788744107.227106:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744107.227116:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed996b8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5864:x1875634068392576:12345-0@lo:502: 00000100:00100000:0.0:1788744107.227433:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed996b8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5864:x1875634068392576:12345-0@lo:502: Request processed in 319us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744107.227441:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744107.227651:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a94f3e07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5864:1875634068392576:0@lo:502: 00000040:00080000:1.0:1788744107.227687:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788744107.228391:0:5817:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788744107.228419:0:5817:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744107.228478:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744107.228491:0:5817:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788744107.228534:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788744107.228537:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788744107.228538:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744107.228539:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744107.228540:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744107.228541:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744107.228543:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744107.228544:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788744107.228545:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744107.228579:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744107.228580:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744107.228582:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744107.228585:0:5817:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788744107.228588:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788744107.228590:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788744107.228591:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744107.228592:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744107.228594:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744107.228595:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744107.228598:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744107.228599:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788744107.228601:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744107.228602:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744107.228603:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744107.228610:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788744107.228630:0:5817:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788744107.228645:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392704:0@lo:253: 00000100:00100000:0.0:1788744107.228703:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744107.228750:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dfa65c58 going to sleep for 11 seconds 00000100:00100000:2.0:1788744107.229999:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392704 00000100:00100000:2.0:1788744107.230022:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392704 00000100:00100000:2.0:1788744107.230075:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744107.230084:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e76e3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5817:x1875634068392704:12345-0@lo:253: 20000000:01000000:2.0:1788744107.230115:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788744107.230129:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788744107.319016:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788744107.319037:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788744107.319093:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744107.319098:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744107.319118:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.319139:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.319147:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.319254:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.319280:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 12 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744107.319294:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068392832:0@lo:104: 00000100:00100000:2.0:1788744107.319354:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744107.319411:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ebb213b going to sleep for 11 seconds 00000100:00100000:1.0:1788744107.319477:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392832 00000100:00100000:1.0:1788744107.319485:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392832 00000100:00100000:1.0:1788744107.319531:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744107.319538:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f2235ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068392832:12345-0@lo:104: 00010000:00010000:1.0:1788744107.319570:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319634:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744107.319640:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f2235ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068392832:12345-0@lo:104: Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744107.319646:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788744107.319666:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744107.319670:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319678:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004edaf72a already unused, calling callback (000000006d402e33) 10000000:00010000:1.0:1788744107.319681:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319689:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744107.319695:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744107.319700:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744107.319723:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319730:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744107.319746:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319752:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 000000004edaf72a/0x7cd2bfd5e1b943ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943b4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.319787:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744107.319789:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744107.319790:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744107.319840:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a94f3e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068392960:0@lo:103: 00000100:00100000:1.0:1788744107.319984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744107.320065:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068392960 00000100:00100000:1.0:1788744107.320070:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068392960 00010000:00010000:1.0:1788744107.320084:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 13 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744107.320106:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744107.320112:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003bf92ea0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3311:x1875634068392960:12345-0@lo:103: 00010000:00010000:1.0:1788744107.320122:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744107.320126:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 13 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320135:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 13 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320149:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320633:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744107.320648:0:5821:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001550360s 00010000:00010000:1.0:1788744107.320652:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320669:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320675:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320681:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320687:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007321613b already unused, calling callback (000000009b682f5c) 00010000:00010000:1.0:1788744107.320690:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320697:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320706:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744107.320716:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744107.320751:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003bf92ea0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3311:x1875634068392960:12345-0@lo:103: Request processed in 639us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744107.320757:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744107.321316:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a94f3e07 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068392960:0@lo:103: 00010000:00010000:2.0:1788744107.321493:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007011895d/0x7cd2bfd5e1b943b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943ad expref: 12 pid: 5830 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744107.321506:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068392832:0@lo:104: 00010000:00010000:2.0:1788744107.321520:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.321528:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.321533:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744107.321538:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007321613b/0x7cd2bfd5e1b943e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744107.331621:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e76e3b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5817:x1875634068392704:12345-0@lo:253: Request processed in 101531us (102912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744107.331641:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744107.331754:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5817:1875634068392704:0@lo:253: 10000000:01000000:0.0:1788744107.331769:0:5817:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788744107.331772:0:5817:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744107.331783:0:5817:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788744107.331784:0:5817:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744107.331785:0:5817:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744107.331786:0:5817:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744107.331788:0:5817:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744107.331789:0:5817:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788744107.331790:0:5817:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788744107.331791:0:5817:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788744107.331792:0:5817:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788744107.331794:0:5817:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744107.331795:0:5817:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744107.331811:0:5817:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788744107.339368:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.340192:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744107.340423:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.340820:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744107.341049:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.341247:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744107.344364:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.344652:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744107.345103:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.345357:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744107.345602:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744107.346067:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788744107.448307:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788744107.506846:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788744107.506992:0:5869:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788744107.506996:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788744107.509145:0:5870:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788744107.515081:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788744107.517611:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788744107.518508:0:5817:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788744107.518521:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788744107.518763:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744107.520509:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788744107.521624:0:5817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788744107.522118:0:5817:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788744107.522433:0:5817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788744107.523052:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788744107.524988:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788744107.525207:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788744107.525534:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788744107.525702:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788744107.525856:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788744107.526198:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788744107.526329:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788744107.528016:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788744107.528326:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788744107.528996:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788744107.529491:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788744107.530366:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788744107.530683:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788744107.530887:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788744107.532539:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788744107.532738:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788744107.533454:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788744107.533704:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788744107.533849:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788744107.534422:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788744107.535046:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788744107.540252:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788744107.541325:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788744107.545116:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788744107.545267:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788744107.545457:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788744107.545645:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788744107.545812:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788744107.545948:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788744107.546111:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788744107.549518:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788744107.549770:0:5817:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788744107.550481:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788744107.666338:0:5870:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00010000:1.0:1788744107.685580:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788744107.717318:0:5817:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788744107.717371:0:5817:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcb701c57988 00100000:10000000:3.0:1788744107.717379:0:5817:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788744107.717987:0:5817:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744107.718050:0:5817:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744107.718064:0:5817:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788744107.718080:0:5817:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788744107.795273:0:5870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788744107.795344:0:5870:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788744107.795349:0:5870:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788744108.700921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744109.723827:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744110.746958:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744111.772131:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744112.677670:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788744112.677680:0:1343:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788744112.677682:0:1343:0:(import.c:65:import_set_state_nolock()) 0000000003c6fb44 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744112.677699:0:1343:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003c6fb44 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744112.677720:0:1343:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bd2c237b x1875634068393216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744112.677755:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd2c237b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068393216:0@lo:38: 00000100:00100000:2.0:1788744112.677819:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744112.678030:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068393088:0@lo:400: 00000100:00100000:0.0:1788744112.678065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744112.682268:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393088 00000100:00100000:2.0:1788744112.682283:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393088 00000100:00100000:2.0:1788744112.682340:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744112.682349:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be026f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3312:x1875634068393088:12345-0@lo:400: 00000100:00100000:2.0:1788744112.682440:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be026f89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3312:x1875634068393088:12345-0@lo:400: Request processed in 93us (4374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744112.682447:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744112.682501:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068393088:0@lo:400: 00000100:00100000:3.0:1788744112.682667:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393216 00000100:00100000:3.0:1788744112.682673:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393216 00000100:00100000:3.0:1788744112.682709:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744112.682712:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032e9012b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875634068393216:12345-0@lo:38: 00010000:00080000:3.0:1788744112.682734:0:5838:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1788744112.682769:0:5838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7cd2bfd5e1b943ec 00000004:00100000:3.0:1788744112.682813:0:5838:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788744112.682975:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000dc76c6af : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744112.683033:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032e9012b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634068393216:12345-0@lo:38: Request processed in 319us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744112.683039:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744112.684572:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bd2c237b x1875634068393216/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744112.684590:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788744112.684598:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788744112.684603:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788744112.684605:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000003c6fb44 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788744112.684610:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd2c237b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068393216:0@lo:38: 00010000:00010000:0.0:1788744112.796031:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788744113.690723:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744113.690730:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac7f4d800 from 3 10000000:01000000:3.0:1788744113.690734:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744113.690771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744113.690783:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744113.690794:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744113.690815:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009da59dfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068393344:0@lo:101: 00000100:00100000:3.0:1788744113.690873:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744113.690928:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 000000000f26a747 going to sleep for 11 seconds 00000100:00100000:2.0:1788744113.691372:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393344 00000100:00100000:2.0:1788744113.691381:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393344 00000100:00100000:2.0:1788744113.691431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744113.691438:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a1315bb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5833:x1875634068393344:12345-0@lo:101: 00010000:00010000:2.0:1788744113.691450:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744113.691462:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042fa9f2f/0x7cd2bfd5e1b943fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b943f3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744113.691485:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042fa9f2f/0x7cd2bfd5e1b943fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744113.691495:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042fa9f2f/0x7cd2bfd5e1b943fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744113.691504:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042fa9f2f, rc 0) 00000100:00100000:2.0:1788744113.691566:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a1315bb2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068393344:12345-0@lo:101: Request processed in 128us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744113.691572:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788744113.691665:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009da59dfb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068393344:0@lo:101: 00010000:00010000:0.0:1788744113.691679:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744113.691687:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744113.691736:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068393472:0@lo:256: 00000100:00100000:0.0:1788744113.691767:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744113.691797:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ea8d61a going to sleep for 11 seconds 00000100:00100000:2.0:1788744113.691931:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393472 00000100:00100000:2.0:1788744113.691936:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393472 00000100:00100000:2.0:1788744113.691966:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744113.691972:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c38c9710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068393472:12345-0@lo:256: 20000000:01000000:2.0:1788744113.691986:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744113.692001:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744113.692004:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788744113.692078:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c38c9710 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068393472:12345-0@lo:256: Request processed in 107us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744113.692085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744113.692115:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000feea3d81 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068393472:0@lo:256: 10000000:01000000:2.0:1788744113.692152:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744113.692160:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744113.692168:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 00000000a443d270/0x7cd2bfd5e1b943f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744113.820242:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744114.102657:0:6112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744114.842936:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744115.867736:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744116.890778:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744117.794330:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744117.794354:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e1c928a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068393600:0@lo:400: 00000100:00100000:3.0:1788744117.794420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744117.794486:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393600 00000100:00100000:3.0:1788744117.794495:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393600 00000100:00100000:3.0:1788744117.794544:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744117.794572:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bc538996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3312:x1875634068393600:12345-0@lo:400: 00000100:00100000:3.0:1788744117.794621:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bc538996 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3312:x1875634068393600:12345-0@lo:400: Request processed in 51us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744117.794629:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788744117.794675:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e1c928a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068393600:0@lo:400: 00000100:00100000:1.0:1788744117.794758:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089914bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068393728:0@lo:400: 00000100:00100000:1.0:1788744117.794794:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744117.797746:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393728 00000100:00100000:3.0:1788744117.797759:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393728 00000100:00100000:3.0:1788744117.797822:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744117.797833:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a94f3e07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068393728:12345-0@lo:400: 00000100:00100000:3.0:1788744117.797922:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a94f3e07 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068393728:12345-0@lo:400: Request processed in 92us (3127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744117.797929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744117.797975:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000089914bee x1875634068393728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744117.797988:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089914bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068393728:0@lo:400: 00010000:00010000:0.0:1788744117.931462:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744118.943808:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744119.972757:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744120.989590:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744121.190836:0:6315:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd21a4550 20000000:00000080:2.0:1788744121.190857:0:6315:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940aced8e800 uarg=0000000000000000 20000000:01000000:2.0:1788744121.190892:0:6315:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788744121.190899:0:6315:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788744121.190904:0:6315:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788744121.191154:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788744121.191166:0:6315:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788744121.206012:0:6315:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744121.206276:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788744121.206521:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788744121.206859:0:6315:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788744121.206878:0:6315:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744121.206969:0:6315:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744121.206987:0:6315:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744121.207008:0:6315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744121.207044:0:6315:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744121.207061:0:6315:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 11 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744121.207075:0:6315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089914bee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1875634068393856:0@lo:104: 00000100:00100000:3.0:1788744121.207136:0:6315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744121.207236:0:6315:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d9a7b329 going to sleep for 11 seconds 00000100:00100000:3.0:1788744121.213231:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393856 00000100:00100000:3.0:1788744121.213248:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393856 00000100:00100000:3.0:1788744121.215369:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744121.215399:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e1c928a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:6315:x1875634068393856:12345-0@lo:104: 00010000:00010000:3.0:1788744121.215419:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744121.215515:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744121.215520:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e1c928a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:6315:x1875634068393856:12345-0@lo:104: Request processed in 142us (8385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744121.215527:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744121.216209:0:6315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089914bee pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6315:1875634068393856:0@lo:104: 00010000:00010000:2.0:1788744121.216233:0:6315:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216569:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744121.216575:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216604:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007926489a already unused, calling callback (000000006d402e33) 10000000:00010000:0.0:1788744121.216607:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216615:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744121.216620:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744121.216626:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744121.216674:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216680:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744121.216700:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216705:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 000000007926489a/0x7cd2bfd5e1b943bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943c2 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744121.216720:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744121.216722:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744121.216723:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744121.216901:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007735de55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068393984:0@lo:103: 00000100:00100000:1.0:1788744121.216958:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744121.217130:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068393984 00000100:00100000:2.0:1788744121.217138:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068393984 00010000:00010000:2.0:1788744121.217166:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 12 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744121.217197:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744121.217204:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007ad3f5ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3311:x1875634068393984:12345-0@lo:103: 00010000:00010000:2.0:1788744121.217215:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744121.217219:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 12 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217239:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 12 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217252:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec008012/0x7cd2bfd5e1b943c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943bb expref: 12 pid: 5830 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217266:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217272:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217303:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217309:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217315:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217321:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217326:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000014cf6bbe already unused, calling callback (000000009b682f5c) 00010000:00010000:2.0:1788744121.217328:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217334:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217357:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217367:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744121.217411:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007ad3f5ea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3311:x1875634068393984:12345-0@lo:103: Request processed in 207us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744121.217418:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788744121.217445:0:6315:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217452:0:6315:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744121.217458:0:6315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000014cf6bbe/0x7cd2bfd5e1b94401 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6315 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744121.219844:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007735de55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068393984:0@lo:103: 00010000:00010000:1.0:1788744122.011471:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744122.908722:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eeb8f224 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068394112:0@lo:400: 00000100:00100000:2.0:1788744122.908800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744122.908867:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744122.908874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4422242 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068394240:0@lo:400: 00000100:00100000:2.0:1788744122.908903:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744122.908946:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394240 00000100:00100000:2.0:1788744122.908955:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394240 00000100:00100000:2.0:1788744122.909000:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744122.909008:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd2c237b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068394240:12345-0@lo:400: 00000100:00100000:2.0:1788744122.909062:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd2c237b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068394240:12345-0@lo:400: Request processed in 55us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744122.909069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744122.909124:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c4422242 x1875634068394240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744122.909139:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4422242 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068394240:0@lo:400: 00000100:00100000:3.0:1788744122.909270:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394112 00000100:00100000:3.0:1788744122.909276:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394112 00000100:00100000:3.0:1788744122.909311:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788744122.909317:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007adecdbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3312:x1875634068394112:12345-0@lo:400: 00000100:00100000:3.0:1788744122.909354:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007adecdbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3312:x1875634068394112:12345-0@lo:400: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744122.909367:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788744122.909446:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eeb8f224 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068394112:0@lo:400: 00010000:00010000:0.0:1788744123.034741:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744124.060706:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744125.083025:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744126.107692:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744127.130947:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744128.030573:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005109e7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068394368:0@lo:400: 00000100:00100000:3.0:1788744128.033269:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744128.033330:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744128.033339:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e57a512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068394496:0@lo:400: 00000100:00100000:3.0:1788744128.033372:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744128.033404:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394368 00000100:00100000:3.0:1788744128.033412:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394368 00000100:00100000:3.0:1788744128.033448:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744128.033456:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006edf4ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3310:x1875634068394368:12345-0@lo:400: 00000100:00100000:3.0:1788744128.033497:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006edf4ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3310:x1875634068394368:12345-0@lo:400: Request processed in 43us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744128.033504:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744128.033530:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394496 00000100:00100000:3.0:1788744128.033533:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394496 00000100:00100000:3.0:1788744128.033574:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744128.033579:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f497555 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068394496:12345-0@lo:400: 00000100:00100000:3.0:1788744128.033604:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f497555 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068394496:12345-0@lo:400: Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744128.033623:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788744128.033655:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009e57a512 x1875634068394496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744128.033668:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e57a512 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068394496:0@lo:400: 00000100:00100000:3.0:1788744128.033676:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005109e7ef pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068394368:0@lo:400: 00010000:00010000:3.0:1788744128.155002:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788744128.950489:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744128.950492:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788744128.950733:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004523bdf4 00000020:01000004:2.0:1788744128.950814:0:6677:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788744128.950826:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788744128.950838:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000d1d48901) 00000020:00000080:2.0:1788744128.950851:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788744128.962993:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788744128.963254:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788744128.986535:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788744128.992044:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788744128.992074:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788744128.992127:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788744128.992156:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788744128.992614:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788744128.992625:0:6677:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744128.992634:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7cd2bfd5e1b9440f 00000020:01000004:3.0:1788744128.992640:0:6677:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788744128.992659:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744128.992661:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744128.992666:0:6677:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788744128.992670:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788744128.992679:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000ec0141a2) 00000020:00000080:3.0:1788744128.992689:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788744128.995333:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744128.995507:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744128.995514:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788744128.996812:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744128.996820:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788744128.997437:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744128.997443:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788744128.999879:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744129.000907:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788744129.000914:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788744129.001510:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788744129.001524:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788744129.018136:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744129.018367:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744129.018373:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788744129.019993:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788744129.020003:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788744129.021049:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744129.021057:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788744129.024427:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744129.025036:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744129.025049:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788744129.026010:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788744129.026018:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788744129.072148:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744129.072326:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744129.072332:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788744129.074573:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788744129.074597:0:6677:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788744129.075289:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788744129.075314:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788744129.075320:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788744129.096036:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744129.096075:0:6677:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.156@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788744129.096079:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744129.096081:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744129.096082:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744129.096087:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744129.096088:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744129.096089:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744129.096090:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744129.096092:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744129.096093:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744129.096094:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744129.096095:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744129.096098:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788744129.096100:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744129.096101:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744129.096102:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744129.096103:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744129.096104:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744129.096105:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744129.096105:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744129.096106:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744129.096107:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744129.096108:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744129.096109:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744129.096136:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788744129.096155:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003d7e584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068394624:0@lo:253: 00000100:00100000:1.0:1788744129.096225:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.096541:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072662926 going to sleep for 11 seconds 00000100:00100000:2.0:1788744129.096770:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394624 00000100:00100000:2.0:1788744129.096779:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394624 00000100:00100000:2.0:1788744129.096918:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744129.096927:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000171dddb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068394624:12345-0@lo:253: 20000000:01000000:2.0:1788744129.096968:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788744129.096972:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788744129.096977:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788744129.096980:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788744129.098080:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744129.098302:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788744129.098316:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788744129.098356:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788744129.098362:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788744129.098384:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788744129.098421:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788744129.099218:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788744129.099239:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.156@tcp 20000000:01000000:2.0:1788744129.099241:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.156@tcp (null) (null) (null) 00000040:00080000:2.0:1788744129.099279:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788744129.099287:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788744129.099496:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788744129.099505:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.156@tcp (null) (null) 00000040:00080000:2.0:1788744129.099538:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788744129.099671:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788744129.099719:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788744129.099900:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788744129.100528:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788744129.100544:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.156@tcp 20000000:01000000:2.0:1788744129.100546:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.156@tcp (null) (null) (null) 00000040:00080000:2.0:1788744129.100619:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788744129.100627:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788744129.100656:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788744129.100663:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.156@tcp (null) (null) 00000040:00080000:2.0:1788744129.100829:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788744129.100838:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788744129.100871:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788744129.100899:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788744129.100914:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788744129.100916:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788744129.100920:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788744129.100931:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788744129.100933:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788744129.100968:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788744129.100970:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788744129.101415:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788744129.101461:0:6692:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788744129.101492:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788744129.101701:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788744129.101865:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788744129.101932:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788744129.101946:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788744129.101948:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788744129.102392:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788744129.102826:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788744129.102872:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788744129.102944:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788744129.102970:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788744129.102972:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788744129.103674:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788744129.103733:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788744129.103943:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788744129.104185:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788744129.104209:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788744129.104226:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788744129.104236:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788744129.104238:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788744129.104246:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788744129.104262:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104281:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104288:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104293:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104300:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104338:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104351:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 11 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.104373:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068394752:0@lo:104: 00000100:00100000:2.0:1788744129.104422:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744129.104519:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104527:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 11 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.104534:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000582b063b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068394880:0@lo:104: 00000100:00100000:2.0:1788744129.104602:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.104861:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394752 00000100:00100000:1.0:1788744129.104868:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394752 00010000:00010000:2.0:1788744129.104881:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.104889:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.104896:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000562186f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068395008:0@lo:104: 00000100:00100000:2.0:1788744129.104919:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.104958:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdcdb3ba going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.104981:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068394880 00000100:00100000:1.0:1788744129.104981:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395008 00000100:00100000:1.0:1788744129.104984:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395008 00000100:00100000:3.0:1788744129.104985:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068394880 00000100:00100000:3.0:1788744129.105001:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744129.105007:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000680a8b94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5830:x1875634068394752:12345-0@lo:104: 00010000:00010000:3.0:1788744129.105019:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.105142:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f6bb301 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068394752:0@lo:104: 00010000:00010000:3.0:1788744129.105147:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744129.105152:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000680a8b94 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5830:x1875634068394752:12345-0@lo:104: Request processed in 145us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.105158:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744129.105180:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744129.105186:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086c711a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:5830:x1875634068395008:12345-0@lo:104: 00010000:00010000:3.0:1788744129.105192:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105250:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744129.105256:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105263:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e696da2f already unused, calling callback (000000006d402e33) 10000000:00010000:0.0:1788744129.105266:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105273:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744129.105279:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744129.105285:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744129.105320:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.105338:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000562186f4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068395008:0@lo:104: 00010000:00010000:0.0:1788744129.105338:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744129.105354:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.105355:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d9282b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068395136:0@lo:103: 00010000:00010000:0.0:1788744129.105360:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 00000000e696da2f/0x7cd2bfd5e1b943c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943d0 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105372:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744129.105374:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.105379:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744129.105379:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000063ca4d6b already unused, calling callback (000000006d402e33) 10000000:00010000:0.0:1788744129.105381:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105387:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744129.105392:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744129.105397:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788744129.105405:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395136 00000100:00100000:2.0:1788744129.105409:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395136 00010000:00010000:0.0:1788744129.105409:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105414:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744129.105421:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105423:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 12 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105427:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 0000000063ca4d6b/0x7cd2bfd5e1b9433d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94344 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.105442:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744129.105443:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744129.105445:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744129.105454:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017a61bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068395264:0@lo:103: 00000100:00100000:0.0:1788744129.105481:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744129.105511:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395264 00000100:00100000:0.0:1788744129.105514:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395264 00000100:00100000:2.0:1788744129.105525:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788744129.105526:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 13 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.105530:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf43a54c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3312:x1875634068395136:12345-0@lo:103: 00000100:00100000:0.0:1788744129.105539:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788744129.105540:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744129.105543:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 13 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744129.105545:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788744129.105578:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 13 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105603:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b943d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943c9 expref: 13 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105615:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744129.105639:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf43a54c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3312:x1875634068395136:12345-0@lo:103: Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744129.105645:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744129.105646:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d9282b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068395136:0@lo:103: 00000100:00100000:2.0:1788744129.105657:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744129.105662:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020a55ef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3313:x1875634068395264:12345-0@lo:103: 00010000:00010000:2.0:1788744129.105669:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744129.105672:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105679:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105688:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000586c9254/0x7cd2bfd5e1b94344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9433d expref: 11 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.105706:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744129.105732:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020a55ef8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:3313:x1875634068395264:12345-0@lo:103: Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744129.105738:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744129.105761:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017a61bcc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068395264:0@lo:103: 00010000:00010000:3.0:1788744129.105965:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788744129.105971:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086c711a0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:5830:x1875634068395008:12345-0@lo:104: Request processed in 786us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.105977:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744129.105994:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744129.106000:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003218c4a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068394880:12345-0@lo:104: 00010000:00010000:3.0:1788744129.106007:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.106035:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744129.106083:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788744129.106083:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744129.106087:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744129.106088:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003218c4a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068394880:12345-0@lo:104: Request processed in 89us (1502us total) trans 0 rc 0/0 00010000:00010000:0.0:1788744129.106094:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061d5d01d already unused, calling callback (000000006d402e33) 00000100:00100000:3.0:1788744129.106095:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:00010000:0.0:1788744129.106096:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106101:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744129.106107:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744129.106112:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744129.106141:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106147:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744129.106161:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106167:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 0000000061d5d01d/0x7cd2bfd5e1b94359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94360 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106180:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744129.106181:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744129.106183:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744129.106259:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d9282b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068395392:0@lo:103: 00000100:00100000:2.0:1788744129.106263:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000582b063b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068394880:0@lo:104: 00010000:00010000:2.0:1788744129.106280:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744129.106285:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744129.106490:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395392 00000100:00100000:0.0:1788744129.106495:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395392 00010000:00010000:0.0:1788744129.106509:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 10 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744129.106600:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744129.106607:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005109e7ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:3310:x1875634068395392:12345-0@lo:103: 00010000:00010000:0.0:1788744129.106615:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744129.106618:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 10 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106626:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 10 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106635:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000265c331b/0x7cd2bfd5e1b94360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94359 expref: 10 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106647:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106660:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106672:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106689:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106696:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106703:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106712:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000573984fb already unused, calling callback (000000009b682f5c) 00010000:00010000:0.0:1788744129.106715:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106723:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106859:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.106865:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.106870:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744129.106871:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.106876:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000573984fb/0x7cd2bfd5e1b9441d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744129.106889:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788744129.106900:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005109e7ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:3310:x1875634068395392:12345-0@lo:103: Request processed in 295us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.106906:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744129.107076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d9282b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068395392:0@lo:103: 00000100:00100000:2.0:1788744129.155108:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000171dddb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:6677:x1875634068394624:12345-0@lo:253: Request processed in 58174us (58875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744129.155123:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744129.155233:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003d7e584 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068394624:0@lo:253: 10000000:01000000:3.0:1788744129.155248:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788744129.155252:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744129.155254:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744129.155255:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744129.155257:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788744129.155258:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744129.155259:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744129.155261:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744129.155262:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788744129.155263:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744129.155265:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744129.155283:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004523bdf4 from lustre-OST0000 10000000:01000000:3.0:1788744129.155304:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788744129.155317:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788744129.155324:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff940ad0d43380 local copy 10000000:01000000:3.0:1788744129.155328:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744129.155360:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.155371:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.155380:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744129.155396:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e57a512 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395520:0@lo:101: 00000100:00100000:3.0:1788744129.155429:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.155527:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0dcd7a1 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.155634:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395520 00000100:00100000:0.0:1788744129.155648:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395520 00000100:00100000:0.0:1788744129.155836:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744129.155845:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000891f2704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:6677:x1875634068395520:12345-0@lo:101: 00010000:00010000:0.0:1788744129.155859:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744129.155871:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b208bc3/0x7cd2bfd5e1b9442b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94424 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.155891:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b208bc3/0x7cd2bfd5e1b9442b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94424 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.155901:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b208bc3/0x7cd2bfd5e1b9442b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94424 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.155908:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b208bc3, rc 0) 00000100:00100000:0.0:1788744129.155948:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000891f2704 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:6677:x1875634068395520:12345-0@lo:101: Request processed in 105us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.155953:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744129.156023:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e57a512 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395520:0@lo:101: 00010000:00010000:1.0:1788744129.156037:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.156044:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744129.156163:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9d2fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395648:0@lo:501: 00000100:00100000:1.0:1788744129.156189:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.156475:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbe5df5b going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.156609:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395648 00000100:00100000:3.0:1788744129.156617:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395648 00000100:00100000:3.0:1788744129.156639:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744129.156646:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb6ea201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:6677:x1875634068395648:12345-0@lo:501: 00000100:00100000:3.0:1788744129.157047:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb6ea201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:6677:x1875634068395648:12345-0@lo:501: Request processed in 401us (857us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744129.157055:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744129.157131:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9d2fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395648:0@lo:501: 10000000:01000000:1.0:1788744129.157146:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788744129.157173:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788744129.157179:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.157187:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.157193:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.157215:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788744129.157246:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff940aceda7000 10000000:01000000:1.0:1788744129.157251:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788744129.157254:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff940ad0d43380 10000000:01000000:1.0:1788744129.157256:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788744129.157259:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff940ad0d43380 from 1 10000000:01000000:1.0:1788744129.157261:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788744129.157281:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.157288:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.157306:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744129.157320:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9d2fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395776:0@lo:101: 00000100:00100000:1.0:1788744129.157348:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.157372:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b842cc37 going to sleep for 11 seconds 00010000:00010000:3.0:1788744129.157450:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744129.157454:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157461:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001966f9f6 already unused, calling callback (000000006d402e33) 10000000:00010000:3.0:1788744129.157463:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157479:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744129.157486:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744129.157491:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744129.157508:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157515:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744129.157539:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157545:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: 000000001966f9f6/0x7cd2bfd5e1b94424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b9442b expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157575:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744129.157576:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744129.157578:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744129.157593:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744129.157604:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008640c3b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068395904:0@lo:103: 00000100:00100000:3.0:1788744129.157628:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.157651:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395776 00000100:00100000:3.0:1788744129.157655:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395776 00000100:00100000:3.0:1788744129.157671:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744129.157688:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ec6cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:6677:x1875634068395776:12345-0@lo:101: 00010000:00010000:3.0:1788744129.157697:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744129.157705:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fca124ba/0x7cd2bfd5e1b94439 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94432 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157725:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fca124ba/0x7cd2bfd5e1b94439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94432 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157742:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fca124ba/0x7cd2bfd5e1b94439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94432 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157749:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fca124ba, rc 0) 00000100:00100000:3.0:1788744129.157774:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ec6cc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:6677:x1875634068395776:12345-0@lo:101: Request processed in 87us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.157780:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744129.157807:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9d2fafe pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068395776:0@lo:101: 00010000:00010000:3.0:1788744129.157815:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157822:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744129.157836:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788744129.157845:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157851:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 00000000df63dd03/0x7cd2bfd5e1b94432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744129.157858:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788744129.157873:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744129.157877:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788744129.157884:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744129.157898:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157904:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.157911:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744129.157922:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396032:0@lo:101: 00000100:00100000:3.0:1788744129.157945:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.157962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396032 00000100:00100000:3.0:1788744129.157966:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396032 00000100:00100000:3.0:1788744129.157981:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744129.157985:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000851798a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:6677:x1875634068396032:12345-0@lo:101: 00010000:00010000:3.0:1788744129.157991:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744129.157997:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b94447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94440 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.158010:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b94447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.158017:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000029454b6/0x7cd2bfd5e1b94447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.158023:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000029454b6, rc 0) 00000100:00100000:3.0:1788744129.158044:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000851798a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396032:12345-0@lo:101: Request processed in 59us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.158050:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744129.158077:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ecaf86e going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.158088:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396032:0@lo:101: 00010000:00010000:3.0:1788744129.158097:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.158103:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744129.158162:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396160:0@lo:501: 00000100:00100000:3.0:1788744129.158185:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.158202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396160 00000100:00100000:3.0:1788744129.158205:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396160 00000100:00100000:3.0:1788744129.158219:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744129.158223:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a13ee61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396160:12345-0@lo:501: 00000100:00100000:3.0:1788744129.158363:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a13ee61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396160:12345-0@lo:501: Request processed in 138us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.158369:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744129.158389:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ecaf86e going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.158400:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396160:0@lo:501: 00000100:00100000:3.0:1788744129.158425:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396288:0@lo:503: 00000100:00100000:3.0:1788744129.158460:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.158479:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396288 00000100:00100000:3.0:1788744129.158482:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396288 00000100:00100000:3.0:1788744129.158497:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744129.158502:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042054720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396288:12345-0@lo:503: 00000100:00100000:3.0:1788744129.158666:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042054720 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396288:12345-0@lo:503: Request processed in 163us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.158680:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744129.158714:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ecaf86e going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.158724:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396288:0@lo:503: 00000040:00080000:3.0:1788744129.158988:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788744129.159052:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396416:0@lo:502: 00000100:00100000:3.0:1788744129.159084:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.159108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396416 00000100:00100000:3.0:1788744129.159113:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396416 00000100:00100000:3.0:1788744129.159130:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744129.159135:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003707ffce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396416:12345-0@lo:502: 00000100:00100000:3.0:1788744129.159238:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003707ffce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396416:12345-0@lo:502: Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.159245:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744129.159268:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c20f120 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.159278:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396416:0@lo:502: 00000040:00080000:3.0:1788744129.159499:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788744129.159544:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788744129.159623:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788744129.159671:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788744129.159707:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788744129.159734:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788744129.159752:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396544:0@lo:502: 00000100:00100000:3.0:1788744129.159783:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.159804:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396544 00000100:00100000:3.0:1788744129.159808:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396544 00000100:00100000:3.0:1788744129.159826:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744129.159831:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001e134ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396544:12345-0@lo:502: 00000100:00100000:3.0:1788744129.159938:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001e134ca3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396544:12345-0@lo:502: Request processed in 107us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.159945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744129.159970:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c20f120 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.159982:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000caa15cfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396544:0@lo:502: 00000040:00080000:3.0:1788744129.160045:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788744129.160054:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:0.0:1788744129.167112:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068395904 00000100:00100000:0.0:1788744129.167130:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068395904 00000100:00100000:0.0:1788744129.167199:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744129.167209:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024436a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:3310:x1875634068395904:12345-0@lo:103: 00010000:00010000:0.0:1788744129.167226:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744129.167243:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b208bc3/0x7cd2bfd5e1b9442b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94424 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.167261:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744129.167476:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024436a38 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:3310:x1875634068395904:12345-0@lo:103: Request processed in 267us (9846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.167484:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744129.167575:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008640c3b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068395904:0@lo:103: 00000020:01000000:3.0:1788744129.167686:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788744129.167694:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788744129.167700:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744129.167702:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788744129.167707:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744129.167721:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000007eb77a62) 00000020:00000080:3.0:1788744129.167740:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788744129.167745:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744129.167968:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004523bdf4 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788744129.167977:0:6697:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788744129.167983:0:6697:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7cd2bfd5e1b94455 00010000:00010000:2.0:1788744129.175885:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788744129.177307:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00010000:00010000:0.0:1788744129.178663:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788744129.180192:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788744129.180691:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788744129.193489:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788744129.195166:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788744129.198721:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788744129.198733:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744129.198738:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744129.198740:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788744129.198743:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744129.198747:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744129.198748:0:6697:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744129.198751:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744129.198753:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744129.199178:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744129.199184:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744129.199194:0:6697:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744129.199197:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788744129.213116:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788744129.213160:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788744129.213284:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.213300:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: 0000000087dfbf65/0x7cd2bfd5e1b94440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744129.213323:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940aceda7000 from 1 10000000:01000000:1.0:1788744129.213326:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744129.213367:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: 000000002d8ab29d/0x7cd2bfd5e1b9445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.213374:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: 000000002d8ab29d/0x7cd2bfd5e1b9445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.213912:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: 000000002d8ab29d/0x7cd2bfd5e1b9445c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744129.213940:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396672:0@lo:101: 00000100:00100000:1.0:1788744129.214019:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.214076:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc09634 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.214161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396672 00000100:00100000:3.0:1788744129.214173:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396672 00000100:00100000:3.0:1788744129.214263:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744129.214272:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b5544e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+10:6677:x1875634068396672:12345-0@lo:101: 00010000:00010000:3.0:1788744129.214285:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744129.214300:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001966f9f6/0x7cd2bfd5e1b94463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9445c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.214324:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001966f9f6/0x7cd2bfd5e1b94463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.214334:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001966f9f6/0x7cd2bfd5e1b94463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.214343:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001966f9f6, rc 0) 00000100:00100000:3.0:1788744129.214397:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b5544e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396672:12345-0@lo:101: Request processed in 126us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.214404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788744129.214489:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396672:0@lo:101: 00010000:00010000:1.0:1788744129.214504:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: 000000002d8ab29d/0x7cd2bfd5e1b9445c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744129.214512:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: 000000002d8ab29d/0x7cd2bfd5e1b9445c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744129.214644:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396800:0@lo:501: 00000100:00100000:1.0:1788744129.214671:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.214942:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc09634 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.214979:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396800 00000100:00100000:0.0:1788744129.214984:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396800 00000100:00100000:0.0:1788744129.215008:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744129.215014:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002537836a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396800:12345-0@lo:501: 00000100:00100000:0.0:1788744129.215329:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002537836a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396800:12345-0@lo:501: Request processed in 314us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.215337:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744129.215533:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396800:0@lo:501: 00000100:00100000:1.0:1788744129.215706:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396928:0@lo:503: 00000100:00100000:1.0:1788744129.215750:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.215816:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc09634 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.215906:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068396928 00000100:00100000:0.0:1788744129.215912:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068396928 00000100:00100000:0.0:1788744129.215975:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788744129.215981:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e315fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396928:12345-0@lo:503: 00000100:00100000:0.0:1788744129.216241:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e315fd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068396928:12345-0@lo:503: Request processed in 261us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.216248:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744129.216321:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068396928:0@lo:503: 00000040:00080000:1.0:1788744129.216748:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744129.216835:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397056:0@lo:502: 00000100:00100000:1.0:1788744129.216879:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.217076:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc09634 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.217120:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397056 00000100:00100000:3.0:1788744129.217126:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397056 00000100:00100000:3.0:1788744129.217154:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744129.217161:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004f5af54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068397056:12345-0@lo:502: 00000100:00100000:3.0:1788744129.217396:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004f5af54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068397056:12345-0@lo:502: Request processed in 235us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.217404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744129.217688:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397056:0@lo:502: 00000040:00080000:1.0:1788744129.218068:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788744129.218126:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788744129.218157:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397184:0@lo:502: 00000100:00100000:1.0:1788744129.218202:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.218276:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set 000000007dc09634 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.218313:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397184 00000100:00100000:3.0:1788744129.218318:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397184 00000100:00100000:3.0:1788744129.218392:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788744129.218399:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012d78355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068397184:12345-0@lo:502: 00000100:00100000:3.0:1788744129.218611:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012d78355 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068397184:12345-0@lo:502: Request processed in 212us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.218618:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744129.218758:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a3aa42c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397184:0@lo:502: 00000040:00080000:1.0:1788744129.218867:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788744129.218877:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788744129.219515:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744129.219525:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744129.219527:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744129.219533:0:6701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940aceda7000 00000020:00000080:1.0:1788744129.219536:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744129.219607:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744129.219611:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744129.219613:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788744129.219616:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788744129.219732:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788744129.219751:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744129.219771:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.219784:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744129.219894:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788744129.219897:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff940aceda7000 10000000:01000000:0.0:1788744129.219900:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff940aceda7000 10000000:01000000:0.0:1788744129.219904:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744129.219910:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940aceda7000 from 1 10000000:01000000:0.0:1788744129.219913:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744129.220100:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220108:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220118:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744129.220133:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397312:0@lo:101: 00000100:00100000:0.0:1788744129.220180:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744129.220211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397312 00000100:00100000:0.0:1788744129.220217:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397312 00000100:00100000:0.0:1788744129.220246:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744129.220253:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068397312:12345-0@lo:101: 00010000:00010000:0.0:1788744129.220265:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744129.220277:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9446a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220302:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220313:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220322:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031600, rc 0) 00000100:00100000:0.0:1788744129.220351:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397312:12345-0@lo:101: Request processed in 98us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.220357:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744129.220394:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.220415:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397312:0@lo:101: 00010000:00010000:0.0:1788744129.220428:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744129.220618:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744129.220693:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397440:0@lo:501: 00000100:00100000:0.0:1788744129.220715:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744129.220870:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.220956:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397440 00000100:00100000:3.0:1788744129.220961:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397440 00000100:00100000:3.0:1788744129.220981:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788744129.220988:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397440:12345-0@lo:501: 00000100:00100000:3.0:1788744129.221201:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397440:12345-0@lo:501: Request processed in 213us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.221208:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744129.221215:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397440:0@lo:501: 00000100:00100000:2.0:1788744129.221244:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397568:0@lo:503: 00000100:00100000:2.0:1788744129.221513:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.221714:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.221768:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397568 00000100:00100000:0.0:1788744129.221772:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397568 00000100:00100000:0.0:1788744129.221900:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788744129.221910:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397568:12345-0@lo:503: 00000100:00100000:0.0:1788744129.222061:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397568:12345-0@lo:503: Request processed in 152us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.222067:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744129.222166:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397568:0@lo:503: 00000040:00080000:2.0:1788744129.222458:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744129.222521:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397696:0@lo:502: 00000100:00100000:2.0:1788744129.222603:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.223334:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744129.223422:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397696 00000100:00100000:1.0:1788744129.223430:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397696 00000100:00100000:1.0:1788744129.223470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744129.223478:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397696:12345-0@lo:502: 00000100:00100000:1.0:1788744129.223725:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397696:12345-0@lo:502: Request processed in 247us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744129.223733:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744129.223932:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397696:0@lo:502: 00000040:00080000:2.0:1788744129.224214:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788744129.224267:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788744129.224301:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788744129.224347:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788744129.224382:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788744129.224430:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788744129.224485:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788744129.224520:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788744129.224616:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788744129.224651:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788744129.224684:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788744129.224745:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788744129.224782:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788744129.224828:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788744129.224873:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788744129.224911:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788744129.224946:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788744129.224993:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788744129.225029:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788744129.225060:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788744129.225106:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788744129.225141:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788744129.225172:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788744129.225219:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788744129.225260:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788744129.225297:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788744129.225344:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788744129.225394:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788744129.225447:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397824:0@lo:502: 00000100:00100000:2.0:1788744129.225509:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.225568:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744129.225941:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397824 00000100:00100000:0.0:1788744129.225949:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397824 00000100:00100000:0.0:1788744129.225987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788744129.225995:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397824:12345-0@lo:502: 00000100:00100000:0.0:1788744129.226916:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068397824:12345-0@lo:502: Request processed in 918us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744129.226924:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744129.227004:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068397824:0@lo:502: 00000040:00080000:2.0:1788744129.227102:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788744129.227116:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788744129.230964:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788744129.230997:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9409c11e0000) 00000020:00000080:3.0:1788744129.231021:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788744129.231088:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940aceda7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788744129.231092:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940aceda7000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788744129.231094:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940aceda7000 3 00010000:00080000:3.0:1788744129.231124:0:6702:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940aff841000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.156@tcp at head 00010000:00010000:3.0:1788744129.234701:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788744129.234981:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788744129.235017:0:6702:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788744129.235030:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7cd2bfd5e1b9447f 00000100:00080000:3.0:1788744129.235040:0:6702:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744129.235054:0:6702:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff940aff841000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:3.0:1788744129.235097:0:6702:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad0c48a80 x1875634068397952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744129.235176:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068397952:0@lo:38: 00000100:00100000:2.0:1788744129.235247:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744129.235350:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068397952 00000100:00100000:1.0:1788744129.235358:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068397952 00000100:00100000:1.0:1788744129.235395:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744129.235403:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068397952:12345-0@lo:38: 00010000:00080000:1.0:1788744129.235425:0:5836:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1788744129.235471:0:5836:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7cd2bfd5e1b94486 00000004:00100000:1.0:1788744129.235486:0:5836:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744129.235517:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9409c118e000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788744129.235694:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744129.235827:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068398080:0@lo:400: 00000100:00100000:0.0:1788744129.235861:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.235913:0:5837:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744129.235921:0:5837:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788744129.235955:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634068397952:12345-0@lo:38: Request processed in 552us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744129.235962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744129.235980:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398080 00000100:00100000:1.0:1788744129.235984:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398080 00010000:00080000:2.0:1788744129.236053:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c48a80 x1875634068397952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744129.236064:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744129.236072:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788744129.236078:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788744129.236236:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788744129.236243:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940aff841000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788744129.236249:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068397952:0@lo:38: 00000100:00100000:1.0:1788744129.236331:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744129.236339:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068398080:12345-0@lo:400: 00000100:00100000:1.0:1788744129.236388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068398080:12345-0@lo:400: Request processed in 50us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744129.236395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788744129.236522:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c4b800 x1875634068398080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744129.236534:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068398080:0@lo:400: 00000040:00080000:3.0:1788744129.237265:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788744129.237881:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788744129.237905:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744129.237956:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.237968:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744129.238042:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744129.238044:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744129.238046:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744129.238047:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744129.238049:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744129.238050:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744129.238052:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744129.238053:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744129.238055:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744129.238056:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744129.238058:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744129.238061:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788744129.238064:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744129.238065:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744129.238066:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744129.238068:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744129.238069:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744129.238070:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744129.238071:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744129.238072:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744129.238073:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744129.238074:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744129.238075:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744129.238094:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788744129.238108:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068398208:0@lo:253: 00000100:00100000:2.0:1788744129.238171:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.238213:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.238507:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398208 00000100:00100000:3.0:1788744129.238513:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398208 00000100:00100000:3.0:1788744129.238577:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744129.238596:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6677:x1875634068398208:12345-0@lo:253: 20000000:01000000:3.0:1788744129.238618:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788744129.238631:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744129.269085:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744129.269139:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788744129.270145:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744129.270152:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744129.270174:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.270194:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.270220:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.270263:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.270280:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 12 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.270296:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068398336:0@lo:104: 00000100:00100000:2.0:1788744129.270363:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744129.270513:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af85029c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744129.270601:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398336 00000100:00100000:3.0:1788744129.270610:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398336 00000100:00100000:3.0:1788744129.270656:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744129.270665:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068398336:12345-0@lo:104: 00010000:00010000:3.0:1788744129.270679:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.270749:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744129.270756:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068398336:12345-0@lo:104: Request processed in 92us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744129.270762:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788744129.270782:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744129.270789:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.270911:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fde00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:3.0:1788744129.270916:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.270938:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744129.270946:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744129.270952:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788744129.270983:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.270990:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744129.271015:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.271023:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fde00/0x7cd2bfd5e1b943f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b943fa expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.271041:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744129.271043:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744129.271044:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744129.271056:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068398464:0@lo:103: 00000100:00100000:3.0:1788744129.271089:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744129.271145:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068398336:0@lo:104: 00010000:00010000:3.0:1788744129.271166:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.271239:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398464 00000100:00100000:2.0:1788744129.271244:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398464 00010000:00010000:2.0:1788744129.271263:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 13 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.271287:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744129.271295:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3313:x1875634068398464:12345-0@lo:103: 00010000:00010000:2.0:1788744129.271305:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744129.271310:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 13 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271320:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 13 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271333:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b943fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b943f3 expref: 13 pid: 5829 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271357:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271366:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744129.271389:0:6695:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001550360s 00010000:00010000:2.0:1788744129.271394:0:6695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271401:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271408:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271414:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271420:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cbe00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744129.271424:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271431:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271448:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744129.271456:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744129.271492:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3313:x1875634068398464:12345-0@lo:103: Request processed in 198us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744129.271499:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744129.271569:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068398464:0@lo:103: 00010000:00010000:3.0:1788744129.271985:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.272006:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744129.272013:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b9448d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744129.281299:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:6677:x1875634068398208:12345-0@lo:253: Request processed in 42704us (43117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744129.281313:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744129.281442:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6677:1875634068398208:0@lo:253: 10000000:01000000:3.0:1788744129.281462:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788744129.281466:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744129.281468:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788744129.281469:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744129.281471:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744129.281472:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744129.281474:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744129.281476:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788744129.281478:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788744129.281479:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788744129.281481:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744129.281482:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788744129.281500:0:6677:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788744129.288627:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744129.289152:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744129.289400:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744129.289696:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744129.290083:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744129.290356:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788744129.291992:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788744129.587199:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788744129.587207:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788744129.587268:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744129.587334:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744129.587352:0:6677:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788744129.587383:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788744130.223413:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788744131.100419:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788744131.100425:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ac7f4d800 from 21 10000000:01000000:1.0:1788744131.100431:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788744131.100481:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744131.100494:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744131.100507:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744131.100543:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398592:0@lo:101: 00000100:00100000:1.0:1788744131.100714:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.100763:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af78bc540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744131.102283:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398592 00000100:00100000:3.0:1788744131.102298:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398592 00000100:00100000:3.0:1788744131.102345:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788744131.102354:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:5833:x1875634068398592:12345-0@lo:101: 00010000:00010000:3.0:1788744131.102381:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744131.102398:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94494 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744131.102428:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744131.102440:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744131.102450:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fce00, rc 0) 00000100:00100000:3.0:1788744131.102534:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068398592:12345-0@lo:101: Request processed in 172us (1811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744131.102540:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744131.104736:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398592:0@lo:101: 00010000:00010000:0.0:1788744131.104788:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744131.104800:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744131.104888:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398720:0@lo:501: 00000100:00100000:0.0:1788744131.104962:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744131.105001:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.105184:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398720 00000100:00100000:2.0:1788744131.105192:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398720 00000100:00100000:2.0:1788744131.105239:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744131.105248:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068398720:12345-0@lo:501: 00000100:00100000:2.0:1788744131.105503:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068398720:12345-0@lo:501: Request processed in 256us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.105510:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744131.105879:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398720:0@lo:501: 00000100:00100000:2.0:1788744131.105928:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398848:0@lo:503: 00000100:00100000:2.0:1788744131.105968:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.105991:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.106002:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398848 00000100:00100000:2.0:1788744131.106006:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398848 00000100:00100000:2.0:1788744131.106029:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744131.106036:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068398848:12345-0@lo:503: 00000100:00100000:2.0:1788744131.106216:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068398848:12345-0@lo:503: Request processed in 180us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.106223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744131.106268:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068398848:0@lo:503: 00000100:00100000:2.0:1788744131.106429:0:6760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6760:1875634068398976:0@lo:502: 00000100:00100000:2.0:1788744131.106457:0:6760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.106473:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068398976 00000100:00100000:2.0:1788744131.106477:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068398976 00000100:00100000:2.0:1788744131.106495:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744131.106501:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6760:x1875634068398976:12345-0@lo:502: 00000100:00100000:2.0:1788744131.106679:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6760:x1875634068398976:12345-0@lo:502: Request processed in 177us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.106685:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788744131.106709:0:6760:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.106719:0:6760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6760:1875634068398976:0@lo:502: 00000100:00100000:2.0:1788744131.106754:0:6760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6760:1875634068399104:0@lo:502: 00000100:00100000:2.0:1788744131.106782:0:6760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.106799:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399104 00000100:00100000:2.0:1788744131.106803:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399104 00000100:00100000:2.0:1788744131.106821:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744131.106826:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6760:x1875634068399104:12345-0@lo:502: 00000100:00100000:2.0:1788744131.106924:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:6760:x1875634068399104:12345-0@lo:502: Request processed in 98us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.106931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744131.106954:0:6760:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.106964:0:6760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6760:1875634068399104:0@lo:502: 00000040:00080000:2.0:1788744131.106982:0:6760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788744131.107030:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788744131.107046:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744131.107059:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107068:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744131.107077:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788744131.107079:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac7f4d800 from 4 10000000:01000000:2.0:1788744131.107082:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788744131.107106:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107114:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107122:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.107132:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399232:0@lo:101: 00000100:00100000:2.0:1788744131.107153:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.107164:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.107174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399232 00000100:00100000:2.0:1788744131.107177:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399232 00000100:00100000:2.0:1788744131.107194:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744131.107199:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068399232:12345-0@lo:101: 00010000:00010000:2.0:1788744131.107206:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744131.107216:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b944a2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107233:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107250:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107258:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29ca800, rc 0) 00000100:00100000:2.0:1788744131.107284:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068399232:12345-0@lo:101: Request processed in 85us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.107290:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744131.107314:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399232:0@lo:101: 00010000:00010000:2.0:1788744131.107324:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107332:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.107371:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399360:0@lo:256: 00000100:00100000:2.0:1788744131.107398:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.107410:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.107420:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399360 00000100:00100000:2.0:1788744131.107423:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399360 00000100:00100000:2.0:1788744131.107443:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788744131.107448:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068399360:12345-0@lo:256: 20000000:01000000:2.0:1788744131.107460:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744131.107478:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744131.107481:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788744131.107582:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068399360:12345-0@lo:256: Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.107589:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788744131.107623:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399360:0@lo:256: 10000000:01000000:2.0:1788744131.107660:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788744131.107665:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107672:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744131.107679:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788744131.107681:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788744131.107683:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744131.107697:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107703:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107710:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.107720:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399488:0@lo:101: 00000100:00100000:2.0:1788744131.107743:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.107754:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.107765:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399488 00000100:00100000:2.0:1788744131.107768:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399488 00000100:00100000:2.0:1788744131.107787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744131.107793:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068399488:12345-0@lo:101: 00010000:00010000:2.0:1788744131.107800:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744131.107808:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b944b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107829:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107837:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107843:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cb000, rc 0) 00000100:00100000:2.0:1788744131.107870:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068399488:12345-0@lo:101: Request processed in 78us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.107876:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788744131.107902:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399488:0@lo:101: 00010000:00010000:2.0:1788744131.107912:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.107919:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.107954:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399616:0@lo:501: 00000100:00100000:2.0:1788744131.107978:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.107989:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.107999:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399616 00000100:00100000:2.0:1788744131.108003:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399616 00000100:00100000:2.0:1788744131.121951:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788744131.122002:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068399616:12345-0@lo:501: 00000100:00100000:2.0:1788744131.122327:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068399616:12345-0@lo:501: Request processed in 362us (14347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744131.122771:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399616:0@lo:501: 00000100:00100000:3.0:1788744131.122833:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399744:0@lo:503: 00000100:00100000:3.0:1788744131.122882:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744131.122933:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3085300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744131.124391:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399744 00000100:00100000:0.0:1788744131.124403:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399744 00000100:00100000:0.0:1788744131.124438:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744131.124448:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068399744:12345-0@lo:503: 00000100:00100000:0.0:1788744131.124805:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068399744:12345-0@lo:503: Request processed in 358us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744131.124813:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744131.125339:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068399744:0@lo:503: 00000100:00100000:2.0:1788744131.140776:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744131.144403:0:6762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6762:1875634068399872:0@lo:502: 00000100:00100000:3.0:1788744131.144494:0:6762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744131.144587:0:6762:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3085c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.145768:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068399872 00000100:00100000:2.0:1788744131.145779:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068399872 00000100:00100000:2.0:1788744131.145841:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788744131.145851:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:6762:x1875634068399872:12345-0@lo:502: 00000100:00100000:2.0:1788744131.146186:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:6762:x1875634068399872:12345-0@lo:502: Request processed in 335us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.146194:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744131.146434:0:6762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6762:1875634068399872:0@lo:502: 00000020:01000000:0.0:1788744131.146472:0:6762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744131.146483:0:6762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788744131.146490:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744131.146493:0:6762:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788744131.146498:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788744131.146502:0:6762:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.156@tcp to nid 0x20000c0a8cc9c (192.168.204.156@tcp) 00000020:01000000:0.0:1788744131.146524:0:6762:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788744131.146527:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744131.146588:0:6762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff940ac60a4d40) 00000020:00000080:0.0:1788744131.146616:0:6762:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788744131.146623:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788744131.146709:0:6762:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788744131.146715:0:6762:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788744131.146722:0:6762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b944c5 00010000:00080000:0.0:1788744131.146755:0:6762:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940af78a2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:0.0:1788744131.147000:0:6762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1788744131.241620:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788744131.277460:0:6762:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788744131.277485:0:6762:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788744131.279119:0:6762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744131.279389:0:6762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744131.279442:0:6762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788744131.279502:0:6762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788744131.290197:0:6767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744131.290204:0:6767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788744131.303478:0:6762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788744131.303498:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788744131.304953:0:6762:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788744131.304984:0:6762:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b944cc 00000100:00080000:2.0:1788744131.304994:0:6762:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744131.305007:0:6762:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff940af78a2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744131.305045:0:6762:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad050a300 x1875634068400000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744131.305064:0:6762:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788744131.305148:0:6762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744131.305154:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744131.305156:0:6762:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788744131.305158:0:6762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744131.305162:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744131.305164:0:6762:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788744131.305166:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788744131.305168:0:6762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788744131.305193:0:6762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6762:1875634068400128:0@lo:502: 00000100:00100000:2.0:1788744131.305267:0:6762:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.305309:0:6762:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.305402:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068400000:0@lo:8: 00000100:00100000:2.0:1788744131.305438:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.305472:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400128 00000100:00100000:2.0:1788744131.305479:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400128 00000100:00100000:2.0:1788744131.305518:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744131.305527:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:6762:x1875634068400128:12345-0@lo:502: 00000100:00100000:1.0:1788744131.307741:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400000 00000100:00100000:1.0:1788744131.307769:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400000 00000100:00100000:1.0:1788744131.307805:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744131.307813:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875634068400000:12345-0@lo:8: 00010000:00080000:1.0:1788744131.307849:0:6680:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1788744131.308085:0:6680:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b944d3 00002000:00100000:1.0:1788744131.308125:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9409c118b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788744131.308129:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788744131.308133:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788744131.308249:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788744131.308393:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788744131.308417:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9409c118f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744131.308501:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634068400000:12345-0@lo:8: Request processed in 687us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744131.308509:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744131.308575:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068400256:0@lo:400: 00000100:00100000:1.0:1788744131.308610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.308637:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744131.308643:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068400384:0@lo:400: 00000100:00100000:1.0:1788744131.308667:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.308706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400256 00000100:00100000:1.0:1788744131.308711:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400256 00000100:00100000:1.0:1788744131.309242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400384 00000100:00100000:1.0:1788744131.309247:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400384 00000100:00100000:1.0:1788744131.309278:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744131.309284:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068400256:12345-0@lo:400: 00000100:00100000:1.0:1788744131.309330:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068400256:12345-0@lo:400: Request processed in 46us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744131.309347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744131.309361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744131.309367:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068400384:12345-0@lo:400: 00000100:00100000:1.0:1788744131.309396:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068400384:12345-0@lo:400: Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744131.309401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788744131.309440:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2d180 x1875634068400384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744131.309454:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068400384:0@lo:400: 00010000:00080000:1.0:1788744131.309466:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2ce00 x1875634068400256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744131.309473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068400256:0@lo:400: 00000100:00100000:2.0:1788744131.310129:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:6762:x1875634068400128:12345-0@lo:502: Request processed in 4601us (4860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.310140:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788744131.310202:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad050a300 x1875634068400000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744131.310211:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744131.310220:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788744131.310227:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744131.310233:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744131.310235:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940af78a2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744131.310248:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744131.310254:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068400000:0@lo:8: 00000100:00080000:2.0:1788744131.310274:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744131.310293:0:6762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6762:1875634068400128:0@lo:502: 00000020:01000000:2.0:1788744131.310322:0:6762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744131.310329:0:6762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744131.310331:0:6762:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788744131.310336:0:6762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788744131.310455:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788744131.310472:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744131.310484:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.310507:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744131.310517:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744131.310520:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac7f4d800 from 1 10000000:01000000:2.0:1788744131.310522:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744131.310580:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.310588:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.310596:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.310611:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400512:0@lo:101: 00000100:00100000:2.0:1788744131.310642:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.310673:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad82cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.310687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400512 00000100:00100000:2.0:1788744131.316113:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400512 00000100:00100000:2.0:1788744131.316188:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744131.316198:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068400512:12345-0@lo:101: 00010000:00010000:2.0:1788744131.316219:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744131.316236:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b944da expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.316265:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.316289:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.316297:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cb800, rc 0) 00000100:00100000:2.0:1788744131.316370:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068400512:12345-0@lo:101: Request processed in 174us (5727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.316376:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744131.316437:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400512:0@lo:101: 00010000:00010000:2.0:1788744131.316455:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.316464:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.316536:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400640:0@lo:501: 00000100:00100000:2.0:1788744131.316598:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.316615:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad82cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.316631:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400640 00000100:00100000:2.0:1788744131.316634:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400640 00000100:00100000:2.0:1788744131.316654:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744131.316659:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068400640:12345-0@lo:501: 00000004:00080000:1.0:1788744131.319244:0:6767:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788744131.319378:0:6767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 203451827822ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788744131.323011:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068400640:12345-0@lo:501: Request processed in 6340us (6402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.323026:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744131.323375:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400640:0@lo:501: 00000100:00100000:2.0:1788744131.323428:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400768:0@lo:503: 00000100:00100000:2.0:1788744131.323485:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.323523:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad82cf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.323537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400768 00000100:00100000:2.0:1788744131.323578:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400768 00000100:00100000:2.0:1788744131.323613:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744131.323622:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068400768:12345-0@lo:503: 00000100:00100000:2.0:1788744131.328435:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068400768:12345-0@lo:503: Request processed in 4807us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.328449:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744131.328528:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068400768:0@lo:503: 00000100:00100000:2.0:1788744131.351671:0:6771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6771:1875634068400896:0@lo:502: 00000100:00100000:2.0:1788744131.351754:0:6771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.351793:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068400896 00000100:00100000:2.0:1788744131.351799:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068400896 00000100:00100000:2.0:1788744131.351841:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744131.351851:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:6771:x1875634068400896:12345-0@lo:502: 00000100:00100000:2.0:1788744131.352612:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:6771:x1875634068400896:12345-0@lo:502: Request processed in 760us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.352620:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744131.352700:0:6771:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad82cf840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.352722:0:6771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6771:1875634068400896:0@lo:502: 00000020:01000000:2.0:1788744131.353378:0:6771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744131.353388:0:6771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744131.353391:0:6771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788744131.353399:0:6771:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ac7f4d800 00000020:00000080:2.0:1788744131.353401:0:6771:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744131.353439:0:6771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6771:1875634068401024:0@lo:502: 00000100:00100000:2.0:1788744131.353483:0:6771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.353510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401024 00000100:00100000:2.0:1788744131.353516:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401024 00000100:00100000:2.0:1788744131.353575:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788744131.353583:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:6771:x1875634068401024:12345-0@lo:502: 00000100:00100000:2.0:1788744131.353741:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:6771:x1875634068401024:12345-0@lo:502: Request processed in 158us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.353749:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788744131.355400:0:6771:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae8178900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.355451:0:6771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:6771:1875634068401024:0@lo:502: 00000020:01000000:2.0:1788744131.355585:0:6771:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744131.355593:0:6771:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744131.355596:0:6771:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788744131.355601:0:6771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788744131.355661:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788744131.355683:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744131.355699:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.355710:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744131.360379:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788744131.360387:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff940ad0d43380 from 1 10000000:01000000:2.0:1788744131.360393:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744131.360435:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.360448:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.360467:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.360491:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068401152:0@lo:101: 00000100:00100000:2.0:1788744131.360577:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.360616:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae8178900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.360637:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401152 00000100:00100000:2.0:1788744131.360644:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401152 00000100:00100000:2.0:1788744131.360704:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744131.360713:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068401152:12345-0@lo:101: 00010000:00010000:2.0:1788744131.360733:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744131.360747:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b944e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.360780:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.360789:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.360797:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cbc00, rc 0) 00000100:00100000:2.0:1788744131.360950:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068401152:12345-0@lo:101: Request processed in 238us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.360957:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744131.361004:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068401152:0@lo:101: 00010000:00010000:2.0:1788744131.361018:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.361037:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744131.361095:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068401280:0@lo:501: 00000100:00100000:2.0:1788744131.361123:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.361136:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae8178900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744131.361148:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401280 00000100:00100000:2.0:1788744131.361152:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401280 00000100:00100000:2.0:1788744131.361170:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744131.361176:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068401280:12345-0@lo:501: 00000100:00100000:2.0:1788744131.361361:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068401280:12345-0@lo:501: Request processed in 184us (237us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744131.361368:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788744131.361396:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068401280:0@lo:501: 10000000:01000000:2.0:1788744131.361417:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788744131.361423:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744131.361431:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744131.450616:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788744131.500440:0:6769:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788744131.500471:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401536:0@lo:7: 00000100:00100000:2.0:1788744131.500536:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744131.500622:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac5372600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744131.500646:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068401408:0@lo:13: 00000100:00100000:3.0:1788744131.500688:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.501018:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401536 00000100:00100000:1.0:1788744131.501026:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401536 00000100:00080000:3.0:1788744131.501073:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744131.501234:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744131.501245:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6769:x1875634068401536:12345-0@lo:7: 00000100:00100000:3.0:1788744131.504216:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401408 00000100:00100000:3.0:1788744131.504228:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401408 00000100:00100000:3.0:1788744131.504374:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744131.504384:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875634068401408:12345-0@lo:13: 00002000:00000024:3.0:1788744131.504421:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788744131.504501:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875634068401408:12345-0@lo:13: Request processed in 118us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744131.504507:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788744131.504583:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0508380 x1875634068401408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744131.504605:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068401408:0@lo:13: 00002000:00080000:1.0:1788744131.510019:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788744131.510028:0:6682:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788744131.510134:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6769:x1875634068401536:12345-0@lo:7: Request processed in 8889us (9594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744131.510143:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744131.510333:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad050a300 x1875634068401536/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744131.510359:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401536:0@lo:7: 00000004:00080000:1.0:1788744131.510372:0:6769:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788744131.510412:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401664:0@lo:5: 00000100:00100000:1.0:1788744131.510444:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.510479:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af78bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744131.510497:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401664 00000100:00100000:1.0:1788744131.510504:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401664 00000100:00100000:1.0:1788744131.510581:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744131.510590:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6769:x1875634068401664:12345-0@lo:5: 00002000:00080000:1.0:1788744131.510615:0:6680:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788744131.510619:0:6680:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788744131.511326:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6769:x1875634068401664:12345-0@lo:5: Request processed in 736us (880us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744131.511333:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788744131.511415:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2ce00 x1875634068401664/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744131.511429:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401664:0@lo:5: 00000004:00080000:0.0:1788744131.511439:0:6769:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788744131.511468:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401792:0@lo:700: 00000100:00100000:0.0:1788744131.511496:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744131.511522:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744131.511655:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401792 00000100:00100000:1.0:1788744131.511661:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401792 00000100:00100000:1.0:1788744131.511899:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744131.511908:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6769:x1875634068401792:12345-0@lo:700: 00000100:00100000:1.0:1788744131.511938:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875634068401920:0@lo:700: 00000100:00100000:1.0:1788744131.511965:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.511982:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af78bcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744131.512039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068401920 00000100:00100000:0.0:1788744131.512044:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068401920 00000100:00100000:0.0:1788744131.512077:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744131.512083:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875634068401920:12345-0@lo:700: 40000000:02000000:0.0:1788744131.631991:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788744131.642196:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6688:x1875634068401920:12345-0@lo:700: Request processed in 130105us (130222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744131.642215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788744131.642834:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2c700 x1875634068401920/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744147 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744131.642850:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6688:1875634068401920:0@lo:700: 40000000:02000000:2.0:1788744131.642863:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1788744131.844920:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6769:x1875634068401792:12345-0@lo:700: Request processed in 333005us (333414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744131.844939:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788744131.845730:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ace16f800 x1875634068401792/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744131.845748:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068401792:0@lo:700: 00000001:00080000:3.0:1788744131.847396:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788744131.847411:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1788744131.918154:0:6769:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788744131.928764:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068402048:0@lo:5: 00000100:00100000:1.0:1788744131.928835:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744131.928904:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3b0d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744131.928967:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402048 00000100:00100000:0.0:1788744131.928976:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402048 00000100:00100000:0.0:1788744131.929024:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744131.929035:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6769:x1875634068402048:12345-0@lo:5: 00002000:00080000:0.0:1788744131.935383:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788744131.935403:0:6681:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788744131.949178:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6769:x1875634068402048:12345-0@lo:5: Request processed in 20136us (20334us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788744131.949191:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788744131.951935:0:6769:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2c000 x1875634068402048/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744147 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744131.952018:0:6769:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788744131.952035:0:6769:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff940af6e2c000 x1875634068402048/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744147 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744131.952047:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6769:1875634068402048:0@lo:5: 00000004:00080000:1.0:1788744131.952061:0:6769:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788744132.268821:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744133.275042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744134.306308:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744135.324758:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744136.350112:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744136.734099:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068402176:0@lo:13: 00000100:00100000:1.0:1788744136.734180:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744136.739099:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068402688:0@lo:400: 00000100:00100000:1.0:1788744136.739180:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744136.743353:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744136.743373:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068402560:0@lo:400: 00000100:00100000:1.0:1788744136.743451:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744136.743496:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068402304:0@lo:400: 00000100:00100000:1.0:1788744136.743798:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744136.743841:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744136.743848:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068402432:0@lo:400: 00000100:00100000:1.0:1788744136.743873:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744136.743912:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402176 00000100:00100000:1.0:1788744136.743922:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402176 00000100:00100000:1.0:1788744136.743979:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744136.743988:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068402176:12345-0@lo:13: 00002000:00000024:1.0:1788744136.744034:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744136.744082:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068402176:12345-0@lo:13: Request processed in 95us (9901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744136.744099:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744136.744123:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402688 00000100:00100000:1.0:1788744136.744127:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402688 00000100:00100000:1.0:1788744136.744150:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744136.744157:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068402688:12345-0@lo:400: 00000100:00100000:1.0:1788744136.744189:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068402688:12345-0@lo:400: Request processed in 33us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744136.744195:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744136.744384:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402304 00000100:00100000:1.0:1788744136.744389:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402304 00000100:00100000:1.0:1788744136.744415:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744136.744421:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068402304:12345-0@lo:400: 00000100:00100000:1.0:1788744136.744480:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068402304:12345-0@lo:400: Request processed in 59us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744136.744486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744136.744517:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402560 00000100:00100000:1.0:1788744136.744521:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402560 00000100:00100000:1.0:1788744136.744723:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402432 00000100:00100000:1.0:1788744136.744727:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402432 00000100:00100000:1.0:1788744136.744749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744136.744754:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068402560:12345-0@lo:400: 00000100:00100000:1.0:1788744136.744786:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068402560:12345-0@lo:400: Request processed in 32us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744136.744791:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744136.744803:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744136.744809:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068402432:12345-0@lo:400: 00000100:00100000:1.0:1788744136.744847:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068402432:12345-0@lo:400: Request processed in 39us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744136.744861:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788744136.744881:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744136.744885:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744136.744917:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2c380 x1875634068402560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744136.744934:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068402560:0@lo:400: 00010000:00080000:1.0:1788744136.744947:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2ce00 x1875634068402176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744136.744964:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068402176:0@lo:13: 00010000:00080000:1.0:1788744136.744974:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2c700 x1875634068402688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744136.744982:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068402688:0@lo:400: 00010000:00080000:1.0:1788744136.745016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2e300 x1875634068402432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744136.745024:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068402432:0@lo:400: 00000100:00100000:1.0:1788744136.745032:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068402304:0@lo:400: 00000001:00080000:3.0:1788744136.885179:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788744137.374720:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744138.295590:0:7052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788744138.402376:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744139.420038:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744140.442753:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744141.467760:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744141.855232:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068402816:0@lo:13: 00000100:00100000:3.0:1788744141.855321:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744141.855412:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402816 00000100:00100000:3.0:1788744141.855421:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402816 00000100:00100000:3.0:1788744141.855478:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744141.855489:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068402816:12345-0@lo:13: 00002000:00000024:3.0:1788744141.855521:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744141.855583:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068402816:12345-0@lo:13: Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744141.855591:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788744141.855626:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744141.855691:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068403072:0@lo:400: 00000100:00100000:3.0:1788744141.855735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744141.855756:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744141.855762:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068403200:0@lo:400: 00000100:00100000:3.0:1788744141.855789:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744141.855819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403072 00000100:00100000:3.0:1788744141.855823:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403072 00000100:00100000:3.0:1788744141.855853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403200 00000100:00100000:3.0:1788744141.855856:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403200 00000100:00100000:3.0:1788744141.855880:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744141.855886:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068403072:12345-0@lo:400: 00000100:00100000:3.0:1788744141.855938:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068403072:12345-0@lo:400: Request processed in 38us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744141.855945:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744141.855958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744141.855965:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068403200:12345-0@lo:400: 00000100:00100000:3.0:1788744141.855992:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068403200:12345-0@lo:400: Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744141.855998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744141.856023:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068402944:0@lo:400: 00000100:00100000:3.0:1788744141.856233:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788744141.856270:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744141.856293:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c49500 x1875634068403200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744141.856307:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068403200:0@lo:400: 00010000:00080000:3.0:1788744141.856318:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c49f80 x1875634068403072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744141.856338:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068403072:0@lo:400: 00010000:00080000:3.0:1788744141.856389:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c48e00 x1875634068402816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744141.856396:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788744141.856411:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068402816:0@lo:13: 00000100:00100000:2.0:1788744141.860244:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068402944 00000100:00100000:2.0:1788744141.860717:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068402944 00000100:00100000:2.0:1788744141.860782:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744141.860792:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3311:x1875634068402944:12345-0@lo:400: 00000100:00100000:2.0:1788744141.860899:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3311:x1875634068402944:12345-0@lo:400: Request processed in 109us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744141.860906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744141.861366:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068402944:0@lo:400: 00010000:00010000:2.0:1788744142.497141:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744143.515288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744144.542246:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744145.567180:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744146.587976:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744146.971947:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068403328:0@lo:400: 00000100:00100000:3.0:1788744146.972010:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744146.972058:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744146.972064:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068403456:0@lo:400: 00000100:00100000:3.0:1788744146.972089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744146.972118:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068403584:0@lo:400: 00000100:00100000:3.0:1788744146.972140:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744146.972156:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744146.972162:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068403712:0@lo:400: 00000100:00100000:3.0:1788744146.972186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744146.972214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403456 00000100:00100000:3.0:1788744146.972222:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403456 00000100:00100000:3.0:1788744146.972273:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403584 00000100:00100000:3.0:1788744146.972277:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403584 00000100:00100000:3.0:1788744146.972304:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744146.972312:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068403456:12345-0@lo:400: 00000100:00100000:3.0:1788744146.972359:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068403456:12345-0@lo:400: Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744146.972365:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744146.972382:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744146.972416:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068403584:12345-0@lo:400: 00000100:00100000:3.0:1788744146.972464:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068403584:12345-0@lo:400: Request processed in 39us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744146.972471:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788744146.972496:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744146.972527:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c49500 x1875634068403584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744146.972541:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068403584:0@lo:400: 00010000:00080000:3.0:1788744146.972590:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c49f80 x1875634068403456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744146.972599:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068403456:0@lo:400: 00000100:00100000:1.0:1788744146.976117:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403328 00000100:00100000:1.0:1788744146.976129:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403328 00000100:00100000:1.0:1788744146.976182:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744146.976192:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068403328:12345-0@lo:400: 00000100:00100000:1.0:1788744146.976298:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068403328:12345-0@lo:400: Request processed in 107us (4287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744146.976306:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744146.976340:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403712 00000100:00100000:1.0:1788744146.976344:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403712 00000100:00100000:1.0:1788744146.976383:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744146.976389:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068403712:12345-0@lo:400: 00000100:00100000:1.0:1788744146.976427:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068403712:12345-0@lo:400: Request processed in 39us (4240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744146.976433:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788744146.976527:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744146.976588:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c48a80 x1875634068403712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744146.976602:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068403712:0@lo:400: 00000100:00100000:3.0:1788744146.977449:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068403840:0@lo:13: 00000100:00100000:3.0:1788744146.977499:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744146.977567:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068403328:0@lo:400: 00000100:00100000:1.0:1788744146.979072:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403840 00000100:00100000:1.0:1788744146.979083:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403840 00000100:00100000:1.0:1788744146.979134:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744146.979143:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068403840:12345-0@lo:13: 00002000:00000024:1.0:1788744146.979178:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744146.979263:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068403840:12345-0@lo:13: Request processed in 121us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744146.979270:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744146.979469:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2d500 x1875634068403840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744146.979489:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068403840:0@lo:13: 00010000:00010000:1.0:1788744147.614638:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744148.644626:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744149.658766:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744150.707085:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788744151.496146:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788744151.496151:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788744151.496293:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff940b004f2800 00000020:01000004:1.0:1788744151.496541:0:7623:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788744151.496599:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788744151.496618:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff940ad0ce99c0) 00000020:00000080:1.0:1788744151.496635:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788744151.542953:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788744151.543230:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788744151.579847:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788744151.587617:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788744151.587675:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788744151.587748:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788744151.587774:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788744151.590116:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788744151.590131:0:7623:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788744151.590143:0:7623:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7cd2bfd5e1b944fd 00000020:01000004:2.0:1788744151.590161:0:7623:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788744151.590184:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788744151.590187:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788744151.590193:0:7623:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788744151.590217:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788744151.590220:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788744151.624537:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744151.624606:0:7623:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.156@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788744151.624610:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744151.624612:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744151.624613:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744151.624615:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744151.624616:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744151.624617:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744151.624619:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744151.624620:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744151.624621:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744151.624623:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744151.624624:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744151.624628:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788744151.624630:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744151.624632:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744151.624633:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744151.624634:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744151.624635:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744151.624636:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744151.624637:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744151.624638:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788744151.624639:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788744151.624640:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744151.624641:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744151.624667:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788744151.624685:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068403968:0@lo:253: 00000100:00100000:1.0:1788744151.624748:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.624817:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1c62780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.625476:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068403968 00000100:00100000:3.0:1788744151.625487:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068403968 00000100:00100000:3.0:1788744151.625541:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788744151.625583:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:7623:x1875634068403968:12345-0@lo:253: 20000000:01000000:3.0:1788744151.625632:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788744151.625637:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788744151.625642:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788744151.625645:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788744151.626873:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788744151.627218:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788744151.627242:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788744151.627285:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788744151.627294:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788744151.639721:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788744151.639824:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788744151.640708:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788744151.640735:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.156@tcp 20000000:01000000:3.0:1788744151.640738:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.156@tcp (null) (null) (null) 00000040:00080000:3.0:1788744151.640783:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788744151.640792:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788744151.640859:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788744151.640868:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.156@tcp (null) (null) 00000040:00080000:3.0:1788744151.640903:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788744151.641014:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788744151.641053:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788744151.641106:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788744151.642518:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788744151.642544:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.156@tcp 20000000:01000000:3.0:1788744151.642770:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.156@tcp (null) (null) (null) 00000040:00080000:3.0:1788744151.642816:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788744151.642825:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788744151.642855:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788744151.642862:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.156@tcp (null) (null) 00000040:00080000:3.0:1788744151.642893:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788744151.642901:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788744151.643242:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788744151.643283:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788744151.643506:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788744151.643510:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788744151.643515:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788744151.643517:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788744151.643528:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788744151.643542:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788744151.643545:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788744151.643662:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788744151.643665:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788744151.644473:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788744151.644544:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788744151.644635:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788744151.645240:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788744151.645282:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788744151.645354:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788744151.645369:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788744151.645371:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788744151.646062:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788744151.646318:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788744151.646359:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788744151.646429:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788744151.646444:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788744151.646446:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788744151.647365:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788744151.647454:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788744151.647489:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788744151.647876:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788744151.648055:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788744151.648115:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788744151.648130:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788744151.648133:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788744151.648757:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788744151.648808:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788744151.648874:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788744151.649392:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788744151.649430:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788744151.649458:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1788744151.649472:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788744151.649489:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649505:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649512:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649518:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649525:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649538:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649582:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649623:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649640:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 16 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.649655:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404096:0@lo:104: 00000100:00100000:3.0:1788744151.649731:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744151.649787:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649795:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.649804:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404224:0@lo:104: 00010000:00010000:3.0:1788744151.649828:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649836:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 16 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.649843:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404352:0@lo:104: 00010000:00010000:3.0:1788744151.649864:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.649877:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 16 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.649886:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404480:0@lo:104: 00000100:00100000:2.0:1788744151.650199:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788744151.650221:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.650243:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.650252:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.650263:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404096 00000100:00100000:2.0:1788744151.650271:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404096 00000100:00100000:2.0:1788744151.650317:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404224 00000100:00100000:2.0:1788744151.650320:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404224 00000100:00100000:2.0:1788744151.650329:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404352 00000100:00100000:2.0:1788744151.650331:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404352 00000100:00100000:2.0:1788744151.650338:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404480 00000100:00100000:2.0:1788744151.650341:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404480 00000100:00100000:2.0:1788744151.650363:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744151.650372:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5830:x1875634068404096:12345-0@lo:104: 00010000:00010000:2.0:1788744151.650387:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.650447:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744151.650453:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f91850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:5830:x1875634068404096:12345-0@lo:104: Request processed in 84us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.650461:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744151.650498:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744151.650505:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5830:x1875634068404224:12345-0@lo:104: 00010000:00010000:2.0:1788744151.650511:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.650561:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744151.650567:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:5830:x1875634068404224:12345-0@lo:104: Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.650573:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744151.650586:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744151.650592:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:5830:x1875634068404352:12345-0@lo:104: 00010000:00010000:2.0:1788744151.650599:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.650623:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788744151.650627:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:5830:x1875634068404352:12345-0@lo:104: Request processed in 37us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.650632:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788744151.650644:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744151.650656:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068404480:12345-0@lo:104: 00010000:00010000:2.0:1788744151.650664:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.650688:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788744151.650693:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068404480:12345-0@lo:104: Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.650698:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788744151.650819:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788744151.650827:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650834:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb400 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744151.650839:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650846:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744151.650853:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744151.650866:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744151.650903:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650909:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744151.650940:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650947:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b944e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944ef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650961:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744151.650964:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650970:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cbe00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744151.650972:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.650978:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744151.650983:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744151.650988:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744151.651000:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651004:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744151.651027:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651034:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b944b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944b7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651041:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744151.651044:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651049:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744151.651051:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651057:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744151.651062:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744151.651067:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744151.651079:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651085:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744151.651089:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651094:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164ee00/0x7cd2bfd5e1b94494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9449b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651104:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744151.651113:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651118:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744151.651120:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651127:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744151.651132:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744151.651137:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744151.651150:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651167:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744151.651172:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651178:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b9446a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94471 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.651188:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744151.651189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744151.651191:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744151.651205:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068404736:0@lo:103: 00000100:00100000:0.0:1788744151.651237:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.651274:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744151.651280:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068405120:0@lo:103: 00000100:00100000:0.0:1788744151.651333:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.651362:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068404864:0@lo:103: 00000100:00100000:0.0:1788744151.651381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.651398:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744151.651404:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068404992:0@lo:103: 00000100:00100000:0.0:1788744151.651421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.651451:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404736 00000100:00100000:0.0:1788744151.651457:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404736 00010000:00010000:0.0:1788744151.651478:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 17 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.651493:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405120 00000100:00100000:0.0:1788744151.651496:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405120 00010000:00010000:0.0:1788744151.651506:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 18 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.651516:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404864 00000100:00100000:0.0:1788744151.651518:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404864 00010000:00010000:0.0:1788744151.651527:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 19 pid: 5830 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.651537:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404992 00000100:00100000:0.0:1788744151.651539:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404992 00010000:00010000:0.0:1788744151.651578:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 20 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.651591:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744151.651598:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3311:x1875634068404736:12345-0@lo:103: 00010000:00010000:0.0:1788744151.651609:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744151.651613:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 20 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.652124:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.652140:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 20 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.652162:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404608:0@lo:104: 00010000:00010000:3.0:1788744151.652174:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744151.652207:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744151.652243:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.652263:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404096:0@lo:104: 00000100:00100000:3.0:1788744151.652272:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404224:0@lo:104: 00000100:00100000:3.0:1788744151.652279:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404352:0@lo:104: 00000100:00100000:3.0:1788744151.652286:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404480:0@lo:104: 00000100:00100000:2.0:1788744151.652373:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068404608 00000100:00100000:2.0:1788744151.652379:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068404608 00010000:00010000:0.0:1788744151.652464:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 20 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652482:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b944ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944e8 expref: 20 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652495:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744151.652534:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068404736:12345-0@lo:103: Request processed in 937us (1296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.652541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744151.652588:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744151.652596:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:3311:x1875634068405120:12345-0@lo:103: 00010000:00010000:0.0:1788744151.652606:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744151.652611:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 18 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652620:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 18 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652629:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b94471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9446a expref: 18 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652639:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744151.652660:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3311:x1875634068405120:12345-0@lo:103: Request processed in 66us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.652665:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744151.652677:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744151.652682:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3312:x1875634068404864:12345-0@lo:103: 00010000:00010000:0.0:1788744151.652697:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744151.652702:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652711:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652719:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b944b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944b0 expref: 16 pid: 5830 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652726:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744151.652752:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:3312:x1875634068404864:12345-0@lo:103: Request processed in 71us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.652758:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744151.652769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744151.652775:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:3312:x1875634068404992:12345-0@lo:103: 00010000:00010000:0.0:1788744151.652782:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744151.652786:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 14 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652794:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 14 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652804:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b9449b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94494 expref: 14 pid: 5828 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.652814:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744151.652834:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3312:x1875634068404992:12345-0@lo:103: Request processed in 60us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.652840:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788744151.652889:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068404992:0@lo:103: 00000100:00100000:0.0:1788744151.652897:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068404864:0@lo:103: 00000100:00100000:2.0:1788744151.653032:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744151.653041:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068404608:12345-0@lo:104: 00010000:00010000:2.0:1788744151.653053:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.653101:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744151.653107:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5830:x1875634068404608:12345-0@lo:104: Request processed in 68us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.653112:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788744151.653162:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744151.653168:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653175:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744151.653179:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653186:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744151.653192:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744151.653197:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788744151.653225:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653233:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744151.653245:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653252:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b94440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94447 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744151.653266:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744151.653268:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744151.653285:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744151.653296:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068405248:0@lo:103: 00000100:00100000:0.0:1788744151.653337:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.653361:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405248 00000100:00100000:0.0:1788744151.653366:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405248 00010000:00010000:0.0:1788744151.653383:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 13 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.653401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744151.653407:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3310:x1875634068405248:12345-0@lo:103: 00010000:00010000:0.0:1788744151.653417:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744151.653421:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 13 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653430:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 13 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653442:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653451:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653466:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653473:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653479:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653495:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653501:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fde00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744151.653505:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653513:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653522:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653531:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744151.653577:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3310:x1875634068405248:12345-0@lo:103: Request processed in 170us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.653583:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744151.653611:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068405248:0@lo:103: 00010000:00010000:0.0:1788744151.653634:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc600/0x7cd2bfd5e1b94447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94440 expref: 12 pid: 5829 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.653642:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5830:1875634068404608:0@lo:104: 00010000:00010000:0.0:1788744151.653667:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653678:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653684:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.653695:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fde00/0x7cd2bfd5e1b94504 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788744151.653707:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788744151.658490:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068405120:0@lo:103: 00000100:00100000:3.0:1788744151.658505:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068404736:0@lo:103: 00010000:00010000:3.0:1788744151.708192:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744151.714120:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:7623:x1875634068403968:12345-0@lo:253: Request processed in 88562us (89361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.714135:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744151.714272:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068403968:0@lo:253: 10000000:01000000:0.0:1788744151.714289:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788744151.714294:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744151.714296:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788744151.714298:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744151.714308:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788744151.714309:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744151.714310:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744151.714312:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744151.714313:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788744151.714315:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744151.714317:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788744151.714338:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff940b004f2800 from lustre-OST0001 10000000:01000000:0.0:1788744151.714362:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788744151.714365:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788744151.714373:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff940ad0d43380 local copy 10000000:01000000:0.0:1788744151.714377:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788744151.714416:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.714426:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.714435:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.714452:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405376:0@lo:101: 00000100:00100000:0.0:1788744151.714507:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.714787:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.716074:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405376 00000100:00100000:3.0:1788744151.716097:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405376 00000100:00100000:3.0:1788744151.716158:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788744151.716168:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+11:7623:x1875634068405376:12345-0@lo:101: 00010000:00010000:3.0:1788744151.716184:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744151.716202:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b94512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9450b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.716230:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b94512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9450b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.716240:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b94512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9450b expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.716249:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744151.716323:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068405376:12345-0@lo:101: Request processed in 157us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.716330:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788744151.716597:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405376:0@lo:101: 00010000:00010000:0.0:1788744151.716617:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.716626:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.716761:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405504:0@lo:501: 00000100:00100000:0.0:1788744151.716797:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.716837:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744151.716946:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405504 00000100:00100000:1.0:1788744151.716951:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405504 00000100:00100000:1.0:1788744151.716988:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744151.717012:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068405504:12345-0@lo:501: 00000100:00100000:1.0:1788744151.717208:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068405504:12345-0@lo:501: Request processed in 213us (410us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744151.717215:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744151.717581:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405504:0@lo:501: 10000000:01000000:0.0:1788744151.717597:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788744151.717621:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788744151.717627:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.717636:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.717643:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.717657:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744151.717675:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff940b004f2800 10000000:01000000:0.0:1788744151.717679:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788744151.717684:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788744151.717692:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744151.717697:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788744151.717700:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788744151.717720:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.717727:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.717736:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.717748:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405632:0@lo:101: 00000100:00100000:0.0:1788744151.717777:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.717800:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.717865:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405632 00000100:00100000:2.0:1788744151.717871:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405632 00000100:00100000:2.0:1788744151.717892:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744151.717899:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068405632:12345-0@lo:101: 00010000:00010000:2.0:1788744151.717908:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744151.717934:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94519 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.717952:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.717967:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.717975:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cb000, rc 0) 00000100:00100000:2.0:1788744151.718008:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068405632:12345-0@lo:101: Request processed in 110us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.718014:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788744151.718174:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405632:0@lo:101: 00010000:00010000:0.0:1788744151.718184:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744151.718192:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744151.718247:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405760:0@lo:501: 00000100:00100000:0.0:1788744151.718297:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.718452:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.718518:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405760 00000100:00100000:3.0:1788744151.718523:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405760 00000100:00100000:3.0:1788744151.718542:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744151.718579:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068405760:12345-0@lo:501: 00000100:00100000:3.0:1788744151.718756:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068405760:12345-0@lo:501: Request processed in 207us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.718763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744151.718830:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405760:0@lo:501: 00000100:00100000:0.0:1788744151.718857:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405888:0@lo:503: 00000100:00100000:0.0:1788744151.718893:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.718939:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788744151.719095:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744151.719104:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.719113:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744151.719117:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.719127:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744151.719135:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744151.719140:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744151.719173:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.719180:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744151.719205:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.719213:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9450b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7cd2bfd5e1b94512 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.719233:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744151.719235:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744151.719236:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744151.719246:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068405888 00000100:00100000:1.0:1788744151.719250:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068405888 00000100:00100000:1.0:1788744151.719280:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744151.719287:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068405888:12345-0@lo:503: 00000100:00100000:1.0:1788744151.719624:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068405888:12345-0@lo:503: Request processed in 337us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744151.719631:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788744151.719823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068406016:0@lo:103: 00000100:00100000:0.0:1788744151.719854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.719944:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068405888:0@lo:503: 00000040:00080000:0.0:1788744151.720244:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744151.720595:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406016 00000100:00100000:2.0:1788744151.720602:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406016 00000100:00100000:2.0:1788744151.720655:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744151.720664:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3312:x1875634068406016:12345-0@lo:103: 00010000:00010000:2.0:1788744151.720677:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744151.720695:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b94512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9450b expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.720711:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744151.720756:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:3312:x1875634068406016:12345-0@lo:103: Request processed in 93us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.720762:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744151.720791:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068406016:0@lo:103: 00000100:00100000:0.0:1788744151.721242:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406144:0@lo:502: 00000100:00100000:0.0:1788744151.721417:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.721465:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.721690:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406144 00000100:00100000:2.0:1788744151.721697:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406144 00000100:00100000:2.0:1788744151.721733:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744151.721741:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068406144:12345-0@lo:502: 00000100:00100000:0.0:1788744151.723264:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068406144:12345-0@lo:502: Request processed in 1510us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.723276:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788744151.723449:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406144:0@lo:502: 00000040:00080000:2.0:1788744151.723895:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788744151.724089:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788744151.724126:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788744151.724189:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788744151.724228:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788744151.724395:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788744151.724435:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406272:0@lo:502: 00000100:00100000:2.0:1788744151.724498:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.724705:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.724838:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406272 00000100:00100000:3.0:1788744151.724846:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406272 00000100:00100000:3.0:1788744151.724936:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788744151.724946:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068406272:12345-0@lo:502: 00000100:00100000:3.0:1788744151.725145:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068406272:12345-0@lo:502: Request processed in 201us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.725169:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744151.725250:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406272:0@lo:502: 00000040:00080000:0.0:1788744151.725382:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788744151.725395:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788744151.726102:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744151.726110:0:7630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788744151.726117:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744151.726119:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788744151.726125:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744151.726139:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff940ad0ce8000) 00000020:00000080:1.0:1788744151.726173:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788744151.726180:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788744151.726259:0:7630:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940b004f2800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788744151.726266:0:7630:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788744151.726275:0:7630:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7cd2bfd5e1b9452e 00010000:00010000:1.0:1788744151.734472:0:7630:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788744151.736056:0:7630:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788744151.744508:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788744151.745729:0:7630:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788744151.758980:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788744151.759494:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788744151.766488:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788744151.766500:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744151.766507:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744151.766510:0:7630:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788744151.766514:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744151.766519:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744151.766520:0:7630:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744151.766523:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744151.766526:0:7630:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788744151.766621:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744151.766625:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744151.766631:0:7630:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788744151.766636:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788744151.769196:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788744151.769246:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788744151.769271:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.769285:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744151.769315:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940b004f2800 from 1 10000000:01000000:1.0:1788744151.769318:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744151.769366:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.769374:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.769384:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744151.769409:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406400:0@lo:101: 00000100:00100000:1.0:1788744151.769485:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.769577:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.769663:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406400 00000100:00100000:2.0:1788744151.769671:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406400 00000100:00100000:2.0:1788744151.769719:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788744151.769729:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:7623:x1875634068406400:12345-0@lo:101: 00010000:00010000:2.0:1788744151.769744:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744151.769757:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94535 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.769787:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.769808:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.769817:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cbc00, rc 0) 00000100:00100000:2.0:1788744151.769862:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406400:12345-0@lo:101: Request processed in 134us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.769869:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744151.770333:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406400:0@lo:101: 00010000:00010000:1.0:1788744151.770351:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744151.770360:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744151.770466:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406528:0@lo:501: 00000100:00100000:1.0:1788744151.770499:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.770537:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.770631:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406528 00000100:00100000:2.0:1788744151.770637:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406528 00000100:00100000:2.0:1788744151.770669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788744151.770677:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406528:12345-0@lo:501: 00000100:00100000:2.0:1788744151.770935:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406528:12345-0@lo:501: Request processed in 258us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.770943:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744151.771719:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406528:0@lo:501: 00000100:00100000:1.0:1788744151.771764:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406656:0@lo:503: 00000100:00100000:1.0:1788744151.771834:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.771874:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744151.771968:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406656 00000100:00100000:0.0:1788744151.771974:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406656 00000100:00100000:0.0:1788744151.772012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788744151.772021:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406656:12345-0@lo:503: 00000100:00100000:0.0:1788744151.772388:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406656:12345-0@lo:503: Request processed in 367us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.772396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788744151.772696:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406656:0@lo:503: 00000040:00080000:1.0:1788744151.772975:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788744151.773057:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406784:0@lo:502: 00000100:00100000:1.0:1788744151.773103:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.773137:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744151.781281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406784 00000100:00100000:0.0:1788744151.781301:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406784 00000100:00100000:0.0:1788744151.781383:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744151.781393:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406784:12345-0@lo:502: 00000100:00100000:0.0:1788744151.781724:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406784:12345-0@lo:502: Request processed in 331us (8618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.781731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788744151.782506:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406784:0@lo:502: 00000040:00080000:1.0:1788744151.783159:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788744151.783223:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788744151.783263:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406912:0@lo:502: 00000100:00100000:1.0:1788744151.783397:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.783487:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.792457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068406912 00000100:00100000:2.0:1788744151.792473:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068406912 00000100:00100000:2.0:1788744151.792577:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788744151.792588:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406912:12345-0@lo:502: 00000100:00100000:2.0:1788744151.794247:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068406912:12345-0@lo:502: Request processed in 1652us (10841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.794272:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788744151.803328:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068406912:0@lo:502: 00000040:00080000:1.0:1788744151.803577:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788744151.803595:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788744151.816850:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744151.816867:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744151.816870:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744151.816879:0:7634:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940b004f2800 00000020:00000080:1.0:1788744151.816881:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744151.816901:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744151.816905:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744151.816907:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788744151.816910:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788744151.817241:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788744151.817270:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744151.817293:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.817306:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744151.817351:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744151.817354:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff940b004f2800 10000000:01000000:2.0:1788744151.817357:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff940b004f2800 10000000:01000000:2.0:1788744151.817361:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744151.817367:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940b004f2800 from 1 10000000:01000000:2.0:1788744151.817369:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744151.817405:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.817415:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.817446:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744151.817469:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407040:0@lo:101: 00000100:00100000:2.0:1788744151.817535:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.817698:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.821525:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407040 00000100:00100000:3.0:1788744151.821542:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407040 00000100:00100000:3.0:1788744151.821627:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788744151.821637:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068407040:12345-0@lo:101: 00010000:00010000:3.0:1788744151.821654:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744151.821672:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94543 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.821700:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.821711:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.821721:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc800, rc 0) 00000100:00100000:3.0:1788744151.822005:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407040:12345-0@lo:101: Request processed in 368us (4469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.822012:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788744151.822114:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407040:0@lo:101: 00010000:00010000:2.0:1788744151.822131:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.822140:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744151.822304:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407168:0@lo:501: 00000100:00100000:2.0:1788744151.822339:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.822416:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744151.829473:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407168 00000100:00100000:1.0:1788744151.829490:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407168 00000100:00100000:1.0:1788744151.829576:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744151.829602:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407168:12345-0@lo:501: 00000100:00100000:1.0:1788744151.830173:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407168:12345-0@lo:501: Request processed in 573us (7831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744151.830183:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744151.830693:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407168:0@lo:501: 00000100:00100000:2.0:1788744151.830754:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407296:0@lo:503: 00000100:00100000:2.0:1788744151.830820:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.830863:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744151.830914:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407296 00000100:00100000:3.0:1788744151.830921:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407296 00000100:00100000:3.0:1788744151.830963:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744151.830971:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407296:12345-0@lo:503: 00000100:00100000:3.0:1788744151.831159:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407296:12345-0@lo:503: Request processed in 175us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.831166:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744151.831802:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407296:0@lo:503: 00000040:00080000:2.0:1788744151.832112:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744151.832210:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407424:0@lo:502: 00000100:00100000:2.0:1788744151.832262:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.833074:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744151.833204:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407424 00000100:00100000:1.0:1788744151.833212:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407424 00000100:00100000:1.0:1788744151.833273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788744151.833285:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407424:12345-0@lo:502: 00000100:00100000:1.0:1788744151.833583:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407424:12345-0@lo:502: Request processed in 300us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744151.833591:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744151.833790:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407424:0@lo:502: 00000040:00080000:2.0:1788744151.834119:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788744151.834189:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788744151.834226:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788744151.834288:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788744151.834349:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788744151.834397:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788744151.834431:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788744151.834468:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788744151.834515:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788744151.834607:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788744151.834645:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788744151.834719:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788744151.834757:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788744151.834790:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788744151.834834:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788744151.834863:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788744151.834893:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788744151.834938:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788744151.834973:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788744151.835006:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788744151.835080:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788744151.835119:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788744151.835159:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788744151.835206:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788744151.835241:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788744151.835274:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788744151.835322:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788744151.835357:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788744151.835391:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788744151.835437:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788744151.835470:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788744151.835521:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788744151.835583:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788744151.835634:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788744151.835671:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788744151.835731:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788744151.835782:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788744151.835830:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407552:0@lo:502: 00000100:00100000:2.0:1788744151.835905:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.835944:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744151.836123:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407552 00000100:00100000:0.0:1788744151.836131:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407552 00000100:00100000:0.0:1788744151.836190:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744151.836199:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407552:12345-0@lo:502: 00000100:00100000:0.0:1788744151.836411:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068407552:12345-0@lo:502: Request processed in 213us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.836419:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788744151.837931:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068407552:0@lo:502: 00000040:00080000:2.0:1788744151.838053:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788744151.838067:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788744151.846320:0:7635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788744151.846338:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff940ad1cd4d40) 00000020:00000080:2.0:1788744151.846363:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788744151.846456:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940b004f2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788744151.846461:0:7635:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940b004f2800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788744151.846464:0:7635:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940b004f2800 3 00010000:00080000:2.0:1788744151.846494:0:7635:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940ace4e2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.156@tcp at head 00010000:00010000:2.0:1788744151.849413:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788744151.849712:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788744151.849750:0:7635:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744151.849763:0:7635:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7cd2bfd5e1b94558 00000100:00080000:2.0:1788744151.849774:0:7635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744151.849786:0:7635:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff940ace4e2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744151.849898:0:7635:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad050b480 x1875634068407680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744151.849920:0:7635:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788744151.850624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068407936:0@lo:400: 00000100:00100000:0.0:1788744151.850696:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.850738:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744151.850743:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068408064:0@lo:400: 00000100:00100000:0.0:1788744151.850767:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744151.850893:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407936 00000100:00100000:1.0:1788744151.850902:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407936 00000100:00100000:1.0:1788744151.850960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744151.850970:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068407936:12345-0@lo:400: 00000100:00100000:0.0:1788744151.851037:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068407680:0@lo:38: 00000100:00100000:2.0:1788744151.854136:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068407808:0@lo:400: 00000100:00100000:1.0:1788744151.854955:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068407936:12345-0@lo:400: Request processed in 3981us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744151.854966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788744151.855008:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744151.855139:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408064 00000100:00100000:1.0:1788744151.855157:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408064 00000100:00100000:1.0:1788744151.855203:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744151.855212:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068408064:12345-0@lo:400: 00000100:00100000:1.0:1788744151.855268:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068408064:12345-0@lo:400: Request processed in 58us (4500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744151.855274:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788744151.855295:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744151.858606:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788744151.858716:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2e680 x1875634068408064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744151.858732:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068408064:0@lo:400: 00010000:00080000:0.0:1788744151.858745:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2c380 x1875634068407936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744151.858753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068407936:0@lo:400: 00000100:00100000:0.0:1788744151.858784:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407680 00000100:00100000:0.0:1788744151.858790:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407680 00000100:00100000:0.0:1788744151.858835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744151.858842:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875634068407680:12345-0@lo:38: 00010000:00080000:0.0:1788744151.858873:0:5837:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1788744151.858909:0:5837:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7cd2bfd5e1b9455f 00000004:00100000:0.0:1788744151.858925:0:5837:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744151.858958:0:5837:0:(import.c:65:import_set_state_nolock()) ffff940af78a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744151.859014:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634068407680:12345-0@lo:38: Request processed in 170us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.859021:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788744151.859052:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad050b480 x1875634068407680/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744151.859060:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744151.859066:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788744151.859073:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744151.859077:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744151.859091:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744151.859097:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068407680:0@lo:38: 00000100:00100000:2.0:1788744151.859838:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788744151.860034:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788744151.860081:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788744151.860108:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744151.860124:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.860135:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744151.860189:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744151.860191:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744151.860192:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744151.860193:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744151.860195:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744151.860196:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744151.860197:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744151.860199:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744151.860200:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744151.860202:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744151.860203:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744151.860207:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788744151.860209:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744151.860210:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744151.860211:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744151.860212:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744151.860213:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744151.860214:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744151.860215:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744151.860217:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744151.860218:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744151.860219:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744151.860219:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744151.860240:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744151.860256:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068408192:0@lo:253: 00000100:00100000:3.0:1788744151.860601:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068407808 00000100:00100000:3.0:1788744151.860609:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068407808 00000100:00100000:3.0:1788744151.860654:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744151.860662:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068407808:12345-0@lo:400: 00000100:00100000:3.0:1788744151.860713:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068407808:12345-0@lo:400: Request processed in 53us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.860719:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744151.860798:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744151.860873:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b3c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788744151.860910:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af6e2ce00 x1875634068407808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744151.860921:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068407808:0@lo:400: 00000100:00100000:0.0:1788744151.864531:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875634068408320:0@lo:901: 00000100:00100000:0.0:1788744151.864763:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744151.864889:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744151.865034:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408320 00000100:00100000:1.0:1788744151.865042:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408320 00000100:00100000:1.0:1788744151.865102:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744151.865111:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875634068408320:12345-0@lo:901: 00000100:00100000:0.0:1788744151.866165:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7636:x1875634068408320:12345-0@lo:901: Request processed in 1031us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744151.866180:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788744151.866184:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788744151.866370:0:7636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ace16c380 x1875634068408320/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788744167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744151.866384:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7636:1875634068408320:0@lo:901: 00000100:00100000:3.0:1788744151.866868:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408192 00000100:00100000:3.0:1788744151.866876:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408192 00000100:00100000:3.0:1788744151.867105:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788744151.867115:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7623:x1875634068408192:12345-0@lo:253: 20000000:01000000:3.0:1788744151.867143:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788744151.867357:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788744151.951125:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788744151.951144:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788744151.951231:0:5852:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788744151.951246:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788744151.951268:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.951285:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.951301:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.951342:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.951357:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 14 pid: 5830 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.951371:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068408448:0@lo:104: 00000100:00100000:3.0:1788744151.951428:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744151.951492:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744151.951761:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408448 00000100:00100000:2.0:1788744151.951770:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408448 00000100:00100000:2.0:1788744151.951832:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744151.951842:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068408448:12345-0@lo:104: 00010000:00010000:2.0:1788744151.951855:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.951922:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744151.951928:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:5852:x1875634068408448:12345-0@lo:104: Request processed in 89us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744151.951935:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788744151.951954:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744151.951960:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.951966:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cba00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744151.951969:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.951977:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744151.951985:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744151.952001:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744151.952390:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.952398:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744151.952422:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.952430:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29cba00/0x7cd2bfd5e1b944a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944a9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.952446:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744151.952448:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744151.952450:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744151.952479:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5852:1875634068408448:0@lo:104: 00010000:00010000:2.0:1788744151.952499:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.952610:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068408576:0@lo:103: 00000100:00100000:3.0:1788744151.952651:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744151.952701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408576 00000100:00100000:3.0:1788744151.952706:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408576 00010000:00010000:3.0:1788744151.952727:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 15 pid: 5830 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.952751:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744151.952758:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:3312:x1875634068408576:12345-0@lo:103: 00010000:00010000:3.0:1788744151.952768:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744151.952773:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 15 pid: 5830 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952783:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 15 pid: 5830 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952809:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29ca800/0x7cd2bfd5e1b944a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944a2 expref: 15 pid: 5830 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952822:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952830:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744151.952844:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001598770s 00010000:00010000:3.0:1788744151.952848:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952856:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952870:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952877:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952883:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fd400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744151.952887:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952895:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952905:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744151.952925:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744151.952954:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:3312:x1875634068408576:12345-0@lo:103: Request processed in 196us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.952960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788744151.953251:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068408576:0@lo:103: 00010000:00010000:2.0:1788744151.953451:0:5852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.953459:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744151.953465:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b94566 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744151.972257:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:7623:x1875634068408192:12345-0@lo:253: Request processed in 105133us (111447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744151.972272:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788744151.972466:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7623:1875634068408192:0@lo:253: 10000000:01000000:2.0:1788744151.972481:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788744151.972497:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744151.972499:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744151.972500:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744151.972502:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744151.972503:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744151.972504:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744151.972506:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744151.972695:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788744151.972697:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788744151.972698:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744151.972700:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744151.972716:0:7623:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788744151.999228:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744152.006046:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744152.008690:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788744152.008904:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788744152.016065:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744152.016772:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788744152.025543:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788744152.097131:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744152.097166:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068408704:0@lo:13: 00000100:00100000:3.0:1788744152.097235:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744152.097299:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408704 00000100:00100000:3.0:1788744152.097306:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408704 00000100:00100000:3.0:1788744152.101308:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744152.101326:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068408704:12345-0@lo:13: 00002000:00000024:3.0:1788744152.101368:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744152.101454:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068408704:12345-0@lo:13: Request processed in 135us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744152.101461:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788744152.102621:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad0c48a80 x1875634068408704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744152.102650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068408704:0@lo:13: 00002000:00080000:1.0:1788744152.503723:0:7623:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788744152.503731:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788744152.503765:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788744152.503834:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788744152.503850:0:7623:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788744152.503880:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788744152.731801:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744153.756141:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744154.780501:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744155.804202:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744156.826946:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744157.213195:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068408832:0@lo:400: 00000100:00100000:3.0:1788744157.213270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744157.213326:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068409344:0@lo:400: 00000100:00100000:3.0:1788744157.213376:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744157.213417:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744157.213422:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068408960:0@lo:400: 00000100:00100000:3.0:1788744157.213443:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744157.213469:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068409088:0@lo:400: 00000100:00100000:3.0:1788744157.213487:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744157.213510:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744157.213514:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068409216:0@lo:400: 00000100:00100000:3.0:1788744157.213537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744157.213580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409344 00000100:00100000:3.0:1788744157.213587:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409344 00000100:00100000:3.0:1788744157.213634:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408960 00000100:00100000:3.0:1788744157.213637:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408960 00000100:00100000:3.0:1788744157.213649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409088 00000100:00100000:3.0:1788744157.213652:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409088 00000100:00100000:3.0:1788744157.213668:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744157.213676:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068409344:12345-0@lo:400: 00000100:00100000:3.0:1788744157.213725:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068409344:12345-0@lo:400: Request processed in 49us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744157.213731:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744157.213748:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744157.213754:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068408960:12345-0@lo:400: 00000100:00100000:3.0:1788744157.213779:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8177100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068408960:12345-0@lo:400: Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744157.213785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744157.213796:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744157.213800:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068409088:12345-0@lo:400: 00000100:00100000:3.0:1788744157.213825:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8177800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068409088:12345-0@lo:400: Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744157.213830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788744157.213853:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409216 00000100:00100000:3.0:1788744157.213856:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409216 00000100:00100000:3.0:1788744157.213879:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744157.213885:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068409216:12345-0@lo:400: 00000100:00100000:3.0:1788744157.213917:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068409216:12345-0@lo:400: Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744157.213922:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788744157.213936:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744157.213940:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744157.214316:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c49500 x1875634068409216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744157.214330:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068409216:0@lo:400: 00010000:00080000:3.0:1788744157.214341:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c4ad80 x1875634068409088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744157.214348:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068409088:0@lo:400: 00000100:00100000:2.0:1788744157.214640:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068409472:0@lo:13: 00000100:00100000:2.0:1788744157.214675:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744157.214710:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409472 00000100:00100000:2.0:1788744157.214715:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409472 00000100:00100000:2.0:1788744157.214745:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744157.214751:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068409472:12345-0@lo:13: 00002000:00000024:2.0:1788744157.214778:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744157.214814:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068409472:12345-0@lo:13: Request processed in 63us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744157.214820:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788744157.214849:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0508700 x1875634068409472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744157.214862:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068409472:0@lo:13: 00010000:00080000:2.0:1788744157.214901:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c49880 x1875634068408960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744157.214911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068408960:0@lo:400: 00010000:00080000:2.0:1788744157.214925:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c48e00 x1875634068409344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744157.214943:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068409344:0@lo:400: 00000100:00100000:1.0:1788744157.215158:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068408832 00000100:00100000:1.0:1788744157.215163:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068408832 00000100:00100000:1.0:1788744157.215194:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788744157.215201:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3310:x1875634068408832:12345-0@lo:400: 00000100:00100000:1.0:1788744157.215241:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:3310:x1875634068408832:12345-0@lo:400: Request processed in 41us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744157.215247:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788744157.215639:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068408832:0@lo:400: 00010000:00010000:2.0:1788744157.852915:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744158.875318:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744159.900092:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744160.807797:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744160.807804:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940aceda7000 from 30 10000000:01000000:0.0:1788744160.807809:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744160.807855:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.807867:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.807878:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744160.807900:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409600:0@lo:101: 00000100:00100000:0.0:1788744160.807963:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.808021:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744160.808151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409600 00000100:00100000:1.0:1788744160.808160:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409600 00000100:00100000:1.0:1788744160.808207:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744160.808215:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068409600:12345-0@lo:101: 00010000:00010000:1.0:1788744160.808228:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744160.808249:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9456d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744160.808272:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744160.808284:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744160.808292:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f600, rc 0) 00000100:00100000:1.0:1788744160.808337:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068409600:12345-0@lo:101: Request processed in 122us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744160.808343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788744160.808751:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409600:0@lo:101: 00010000:00010000:0.0:1788744160.808767:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.808792:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744160.808848:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409728:0@lo:501: 00000100:00100000:0.0:1788744160.808872:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.808889:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.812017:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409728 00000100:00100000:2.0:1788744160.812027:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409728 00000100:00100000:2.0:1788744160.812065:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744160.812074:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068409728:12345-0@lo:501: 00000100:00100000:2.0:1788744160.812424:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068409728:12345-0@lo:501: Request processed in 351us (3550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.812431:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744160.812484:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409728:0@lo:501: 00000100:00100000:2.0:1788744160.812521:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409856:0@lo:503: 00000100:00100000:2.0:1788744160.812558:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.812599:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.812611:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409856 00000100:00100000:2.0:1788744160.812615:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409856 00000100:00100000:2.0:1788744160.812629:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788744160.812634:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068409856:12345-0@lo:503: 00000100:00100000:2.0:1788744160.816456:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068409856:12345-0@lo:503: Request processed in 3813us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.816471:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744160.816597:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068409856:0@lo:503: 00000100:00100000:0.0:1788744160.817354:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7927:1875634068409984:0@lo:502: 00000100:00100000:0.0:1788744160.817400:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.817425:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744160.817469:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068409984 00000100:00100000:1.0:1788744160.817475:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068409984 00000100:00100000:1.0:1788744160.817512:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788744160.817520:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7927:x1875634068409984:12345-0@lo:502: 00000100:00100000:1.0:1788744160.817948:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7927:x1875634068409984:12345-0@lo:502: Request processed in 427us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744160.817955:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788744160.818036:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7927:1875634068409984:0@lo:502: 00000100:00100000:0.0:1788744160.818075:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7927:1875634068410112:0@lo:502: 00000100:00100000:0.0:1788744160.818106:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.818135:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.818335:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410112 00000100:00100000:2.0:1788744160.818339:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410112 00000100:00100000:2.0:1788744160.818368:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744160.818376:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7927:x1875634068410112:12345-0@lo:502: 00000100:00100000:2.0:1788744160.818508:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:7927:x1875634068410112:12345-0@lo:502: Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.818514:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788744160.818545:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7927:1875634068410112:0@lo:502: 00000040:00080000:2.0:1788744160.818582:0:7927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788744160.818629:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788744160.818647:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744160.818655:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.818667:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744160.818676:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788744160.818679:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788744160.818693:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788744160.818870:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.818879:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.818888:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.818900:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410240:0@lo:101: 00000100:00100000:2.0:1788744160.818925:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.818938:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.818948:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410240 00000100:00100000:2.0:1788744160.818957:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410240 00000100:00100000:2.0:1788744160.818972:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788744160.818997:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068410240:12345-0@lo:101: 00010000:00010000:2.0:1788744160.819005:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744160.819190:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9457b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.819215:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.819226:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.819235:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cba00, rc 0) 00000100:00100000:2.0:1788744160.819263:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410240:12345-0@lo:101: Request processed in 267us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.819269:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788744160.819294:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410240:0@lo:101: 00010000:00010000:2.0:1788744160.819305:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.819313:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.819350:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410368:0@lo:501: 00000100:00100000:2.0:1788744160.819385:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.819395:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.819405:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410368 00000100:00100000:2.0:1788744160.819408:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410368 00000100:00100000:2.0:1788744160.819428:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788744160.819433:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410368:12345-0@lo:501: 00000100:00100000:2.0:1788744160.819633:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410368:12345-0@lo:501: Request processed in 199us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.819639:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788744160.819663:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410368:0@lo:501: 00000100:00100000:2.0:1788744160.820474:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410496:0@lo:503: 00000100:00100000:2.0:1788744160.820515:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.820597:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.831971:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410496 00000100:00100000:0.0:1788744160.831994:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410496 00000100:00100000:0.0:1788744160.833264:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788744160.833276:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410496:12345-0@lo:503: 00000100:00100000:0.0:1788744160.835350:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410496:12345-0@lo:503: Request processed in 2072us (14829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.835362:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744160.846249:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410496:0@lo:503: 00000100:00100000:3.0:1788744160.847215:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7931:1875634068410624:0@lo:502: 00000100:00100000:3.0:1788744160.847298:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.847343:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3afcd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.847431:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410624 00000100:00100000:2.0:1788744160.847437:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410624 00000100:00100000:2.0:1788744160.847476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744160.847485:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:7931:x1875634068410624:12345-0@lo:502: 00000100:00100000:2.0:1788744160.850009:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:7931:x1875634068410624:12345-0@lo:502: Request processed in 2520us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744160.850830:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7931:1875634068410624:0@lo:502: 00000020:01000000:3.0:1788744160.850865:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744160.850875:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744160.850877:0:7931:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744160.850881:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744160.850883:0:7931:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788744160.850910:0:7931:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7931:1875634068410752:0@lo:502: 00000100:00100000:3.0:1788744160.850953:0:7931:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.851001:0:7931:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ace161840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.851103:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788744160.851246:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410752 00000100:00100000:2.0:1788744160.851252:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410752 00000100:00100000:2.0:1788744160.851293:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788744160.851301:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:7931:x1875634068410752:12345-0@lo:502: 00000100:00100000:2.0:1788744160.851451:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:7931:x1875634068410752:12345-0@lo:502: Request processed in 150us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.851457:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788744160.851674:0:7931:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7931:1875634068410752:0@lo:502: 00000020:01000000:3.0:1788744160.851702:0:7931:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744160.852855:0:7931:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744160.852858:0:7931:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744160.852864:0:7931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788744160.853110:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788744160.853139:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788744160.853154:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.853168:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744160.853178:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788744160.853180:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ac7f4d800 from 30 10000000:01000000:2.0:1788744160.853183:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744160.853212:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.853220:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.853231:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.853246:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410880:0@lo:101: 00000100:00100000:2.0:1788744160.853290:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.853325:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.853406:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068410880 00000100:00100000:0.0:1788744160.853413:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068410880 00000100:00100000:0.0:1788744160.853462:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788744160.853469:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068410880:12345-0@lo:101: 00010000:00010000:0.0:1788744160.853486:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744160.853497:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94589 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.853519:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.853530:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.853538:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031e00, rc 0) 00000100:00100000:0.0:1788744160.853598:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068410880:12345-0@lo:101: Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.853605:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744160.853832:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068410880:0@lo:101: 00010000:00010000:3.0:1788744160.853846:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744160.853855:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744160.853898:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411008:0@lo:501: 00000100:00100000:3.0:1788744160.853922:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.853949:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ace161840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.853997:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411008 00000100:00100000:0.0:1788744160.854001:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411008 00000100:00100000:0.0:1788744160.854029:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788744160.854035:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068411008:12345-0@lo:501: 00000100:00100000:0.0:1788744160.854271:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068411008:12345-0@lo:501: Request processed in 236us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.854278:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788744160.854302:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411008:0@lo:501: 00000100:00100000:0.0:1788744160.854327:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411136:0@lo:503: 00000100:00100000:0.0:1788744160.854358:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.854374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411136 00000100:00100000:0.0:1788744160.854377:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411136 00000100:00100000:0.0:1788744160.854390:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788744160.854395:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068411136:12345-0@lo:503: 00000100:00100000:0.0:1788744160.854524:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068411136:12345-0@lo:503: Request processed in 128us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.854530:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788744160.854573:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.854584:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411136:0@lo:503: 00000100:00100000:3.0:1788744160.859904:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8177b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7932:1875634068411264:0@lo:502: 00000100:00100000:3.0:1788744160.859997:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.860040:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ace161d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.860622:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411264 00000100:00100000:0.0:1788744160.860630:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411264 00000100:00100000:0.0:1788744160.860670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788744160.860688:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:7932:x1875634068411264:12345-0@lo:502: 00000100:00100000:0.0:1788744160.860946:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:7932:x1875634068411264:12345-0@lo:502: Request processed in 266us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.860954:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788744160.861330:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8177b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7932:1875634068411264:0@lo:502: 00000100:00100000:2.0:1788744160.861385:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7932:1875634068411392:0@lo:502: 00000100:00100000:2.0:1788744160.861421:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.861445:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.861628:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411392 00000100:00100000:0.0:1788744160.861633:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411392 00000100:00100000:0.0:1788744160.861659:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788744160.861665:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:7932:x1875634068411392:12345-0@lo:502: 00000100:00100000:0.0:1788744160.862920:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:7932:x1875634068411392:12345-0@lo:502: Request processed in 1252us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.862929:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744160.863037:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7932:1875634068411392:0@lo:502: 00000040:00080000:2.0:1788744160.863061:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788744160.863892:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788744160.863915:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744160.863923:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.863936:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744160.863959:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788744160.863962:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac7f4d800 from 5 10000000:01000000:0.0:1788744160.863965:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744160.864009:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.864259:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.864270:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744160.864288:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411520:0@lo:101: 00000100:00100000:0.0:1788744160.864325:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.864374:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.864439:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411520 00000100:00100000:2.0:1788744160.864450:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411520 00000100:00100000:2.0:1788744160.864484:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788744160.864491:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068411520:12345-0@lo:101: 00010000:00010000:2.0:1788744160.864502:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744160.864514:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29ca000/0x7cd2bfd5e1b9459e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94597 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.864535:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29ca000/0x7cd2bfd5e1b9459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94597 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.864544:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29ca000/0x7cd2bfd5e1b9459e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94597 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.864571:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29ca000, rc 0) 00000100:00100000:2.0:1788744160.864600:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068411520:12345-0@lo:101: Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.864606:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744160.864803:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411520:0@lo:101: 00010000:00010000:0.0:1788744160.864815:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.864824:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744160.864865:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411648:0@lo:256: 00000100:00100000:0.0:1788744160.864893:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.864919:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744160.865808:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411648 00000100:00100000:2.0:1788744160.865814:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411648 00000100:00100000:2.0:1788744160.865840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744160.865847:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068411648:12345-0@lo:256: 20000000:01000000:2.0:1788744160.865861:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788744160.865877:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788744160.865880:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788744160.866261:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068411648:12345-0@lo:256: Request processed in 413us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744160.866269:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788744160.879903:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411648:0@lo:256: 10000000:01000000:3.0:1788744160.880005:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744160.880135:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744160.880148:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744160.880159:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788744160.880162:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788744160.880165:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744160.880196:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744160.880210:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744160.880220:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744160.880237:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411776:0@lo:101: 00000100:00100000:3.0:1788744160.880292:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.880335:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ace161480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.883835:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411776 00000100:00100000:0.0:1788744160.883848:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411776 00000100:00100000:0.0:1788744160.883900:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744160.883919:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068411776:12345-0@lo:101: 00010000:00010000:0.0:1788744160.883935:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744160.883951:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b945a5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.883990:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.884002:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.884011:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031600, rc 0) 00000100:00100000:0.0:1788744160.884090:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068411776:12345-0@lo:101: Request processed in 173us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.884097:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788744160.885862:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411776:0@lo:101: 00010000:00010000:2.0:1788744160.885884:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.885903:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.885988:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411904:0@lo:501: 00000100:00100000:2.0:1788744160.887320:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.887366:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.887799:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068411904 00000100:00100000:0.0:1788744160.887806:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068411904 00000100:00100000:0.0:1788744160.887852:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788744160.887860:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068411904:12345-0@lo:501: 00000100:00100000:0.0:1788744160.888291:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068411904:12345-0@lo:501: Request processed in 430us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.888299:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788744160.889312:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068411904:0@lo:501: 00000100:00100000:2.0:1788744160.889355:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068412032:0@lo:503: 00000100:00100000:2.0:1788744160.889397:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.889425:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.891094:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412032 00000100:00100000:0.0:1788744160.891102:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412032 00000100:00100000:0.0:1788744160.891355:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788744160.891365:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068412032:12345-0@lo:503: 00000100:00100000:0.0:1788744160.892810:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068412032:12345-0@lo:503: Request processed in 1444us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.892827:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744160.892946:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068412032:0@lo:503: 00000100:00100000:1.0:1788744160.893971:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7935:1875634068412160:0@lo:502: 00000100:00100000:1.0:1788744160.894194:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744160.894235:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.894620:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412160 00000100:00100000:0.0:1788744160.894626:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412160 00000100:00100000:0.0:1788744160.894861:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788744160.894871:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:7935:x1875634068412160:12345-0@lo:502: 00000100:00100000:0.0:1788744160.895277:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:7935:x1875634068412160:12345-0@lo:502: Request processed in 406us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.895284:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744160.895357:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7935:1875634068412160:0@lo:502: 00000020:01000000:1.0:1788744160.895381:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744160.895388:0:7935:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788744160.895394:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744160.895396:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788744160.895406:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744160.895409:0:7935:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.156@tcp to nid 0x20000c0a8cc9c (192.168.204.156@tcp) 00000020:01000000:1.0:1788744160.895429:0:7935:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788744160.895432:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744160.895444:0:7935:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff940ad0ceb380) 00000020:00000080:1.0:1788744160.895463:0:7935:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788744160.895467:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744160.895543:0:7935:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788744160.895564:0:7935:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788744160.895571:0:7935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b945ba 00010000:00080000:1.0:1788744160.895597:0:7935:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9409c2137000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:1.0:1788744160.895823:0:7935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788744160.896110:0:7935:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788744160.896120:0:7935:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788744160.904536:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744160.904894:0:7935:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744160.904941:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788744160.905011:0:7935:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788744160.915086:0:7936:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744160.915093:0:7936:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788744160.919104:0:7935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788744160.919118:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788744160.919283:0:7935:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788744160.919306:0:7935:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b945c1 00000100:00080000:3.0:1788744160.919316:0:7935:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744160.919328:0:7935:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9409c2137000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:3.0:1788744160.919363:0:7935:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad8174e00 x1875634068412288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788744160.919391:0:7935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788744160.919437:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744160.919440:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744160.919442:0:7935:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788744160.919445:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744160.919449:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744160.919451:0:7935:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744160.919453:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744160.919456:0:7935:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788744160.919486:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7935:1875634068412416:0@lo:502: 00000100:00100000:3.0:1788744160.919580:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744160.919631:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ace161480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.920907:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412416 00000100:00100000:0.0:1788744160.920916:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412416 00000100:00100000:2.0:1788744160.923365:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068412288:0@lo:8: 00000100:00100000:2.0:1788744160.923442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744160.923916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788744160.923932:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:7935:x1875634068412416:12345-0@lo:502: 00000100:00100000:0.0:1788744160.924756:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:7935:x1875634068412416:12345-0@lo:502: Request processed in 828us (5174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.924765:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00010000:0.0:1788744160.924836:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744160.930353:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412288 00000100:00100000:1.0:1788744160.930365:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412288 00000100:00100000:1.0:1788744160.930400:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744160.930408:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3309:x1875634068412288:12345-0@lo:8: 00010000:00080000:1.0:1788744160.930436:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1788744160.930462:0:6682:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b945c8 00002000:00100000:1.0:1788744160.930475:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9409c2136000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788744160.930479:0:6682:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788744160.930483:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788744160.930637:0:6682:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788744160.930985:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:7935:1875634068412416:0@lo:502: 00000020:01000000:3.0:1788744160.931026:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744160.931032:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744160.931035:0:7935:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788744160.931040:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:1.0:1788744160.936238:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744160.936291:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9409c2130800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744160.936387:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634068412288:12345-0@lo:8: Request processed in 5976us (12940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744160.936396:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744160.936441:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068412544:0@lo:400: 00000100:00100000:1.0:1788744160.936475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744160.936505:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744160.936511:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068412672:0@lo:400: 00000100:00100000:1.0:1788744160.936528:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744160.936570:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068412800:0@lo:400: 00000100:00100000:1.0:1788744160.936594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744160.936609:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744160.936614:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068412928:0@lo:400: 00000100:00100000:1.0:1788744160.936631:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744160.936656:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412800 00000100:00100000:1.0:1788744160.936663:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412800 00000020:01000000:2.0:1788744160.936904:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788744160.936930:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788744160.936940:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.936952:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744160.936963:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788744160.936966:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff940ad0d43380 from 1 10000000:01000000:2.0:1788744160.936968:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744160.937016:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.937034:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.937044:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.937059:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068413056:0@lo:101: 00000100:00100000:2.0:1788744160.937087:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.937115:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744160.937374:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413056 00000100:00100000:0.0:1788744160.937379:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413056 00000100:00100000:0.0:1788744160.937407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744160.937415:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068413056:12345-0@lo:101: 00010000:00010000:0.0:1788744160.937425:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744160.937436:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b945cf expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.937456:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.937467:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744160.937481:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031a00, rc 0) 00000100:00100000:0.0:1788744160.937508:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068413056:12345-0@lo:101: Request processed in 94us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.937515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788744160.937583:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412544 00000100:00100000:0.0:1788744160.937587:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412544 00000100:00100000:0.0:1788744160.937607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412672 00000100:00100000:0.0:1788744160.937609:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412672 00000100:00100000:0.0:1788744160.937619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068412928 00000100:00100000:0.0:1788744160.937621:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068412928 00000100:00100000:0.0:1788744160.937632:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744160.937638:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068412544:12345-0@lo:400: 00000100:00100000:0.0:1788744160.937670:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068412544:12345-0@lo:400: Request processed in 32us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.937675:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744160.937698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744160.937704:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068412672:12345-0@lo:400: 00000100:00100000:0.0:1788744160.937735:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068412672:12345-0@lo:400: Request processed in 31us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.937741:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744160.937751:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788744160.937756:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068412928:12345-0@lo:400: 00000100:00100000:0.0:1788744160.937780:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068412928:12345-0@lo:400: Request processed in 25us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744160.937786:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788744160.937822:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8174e00 x1875634068412288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744160.937837:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744160.937846:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788744160.937852:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788744160.937857:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788744160.937859:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9409c2137000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788744160.937870:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788744160.937875:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8174e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068412288:0@lo:8: 00000004:00080000:3.0:1788744160.938251:0:7936:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744160.938383:0:7936:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 233070832996ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788744160.942267:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068413056:0@lo:101: 00010000:00010000:2.0:1788744160.942297:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744160.942310:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744160.942389:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068413184:0@lo:501: 00000100:00100000:2.0:1788744160.942438:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744160.942485:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaadb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744160.943940:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744160.943954:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068412800:12345-0@lo:400: 00000100:00100000:1.0:1788744160.944035:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068412800:12345-0@lo:400: Request processed in 87us (7440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744160.944042:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788744160.944073:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744160.944079:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744160.944105:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2ce00 x1875634068412672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744160.944118:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068412672:0@lo:400: 00010000:00080000:1.0:1788744160.944129:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2ca80 x1875634068412544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744160.944146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068412544:0@lo:400: 00010000:00080000:1.0:1788744160.944184:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2e680 x1875634068412928/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744160.944193:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068412928:0@lo:400: 00010000:00080000:1.0:1788744160.944203:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2c380 x1875634068412800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744160.944515:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413184 00000100:00100000:3.0:1788744160.944523:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413184 00000100:00100000:3.0:1788744160.944570:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788744160.944577:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068413184:12345-0@lo:501: 00000100:00100000:3.0:1788744160.944808:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068413184:12345-0@lo:501: Request processed in 231us (2369us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744160.944815:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788744160.945907:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068412800:0@lo:400: 00000100:00100000:3.0:1788744160.946848:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068413184:0@lo:501: 10000000:01000000:3.0:1788744160.946881:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744160.946890:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744160.946900:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744161.083663:0:7938:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788744161.083708:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413440:0@lo:7: 00000100:00100000:1.0:1788744161.083775:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744161.083824:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac5372d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744161.083841:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068413312:0@lo:13: 00000100:00100000:1.0:1788744161.083862:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744161.083897:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413440 00000100:00100000:1.0:1788744161.083903:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413440 00000100:00100000:1.0:1788744161.083948:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744161.083955:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1875634068413440:12345-0@lo:7: 00002000:00080000:1.0:1788744161.113000:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788744161.113008:0:6680:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788744161.113098:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7938:x1875634068413440:12345-0@lo:7: Request processed in 29138us (29318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744161.113108:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744161.113149:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413312 00000100:00100000:1.0:1788744161.113156:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413312 00000100:00100000:1.0:1788744161.113202:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744161.113210:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068413312:12345-0@lo:13: 00002000:00000024:1.0:1788744161.113239:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788744161.113271:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068413312:12345-0@lo:13: Request processed in 63us (29408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744161.113277:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788744161.113295:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788744161.113340:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2e680 x1875634068413440/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788744177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744161.113354:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413440:0@lo:7: 00000004:00080000:1.0:1788744161.113365:0:7938:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00010000:00080000:0.0:1788744161.118340:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2c380 x1875634068413312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744161.118367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068413312:0@lo:13: 00000100:00100000:1.0:1788744161.121699:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413568:0@lo:5: 00000100:00100000:1.0:1788744161.121766:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744161.121820:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac5372d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744161.121844:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413568 00000100:00100000:1.0:1788744161.121851:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413568 00000100:00100000:1.0:1788744161.121890:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744161.121898:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7938:x1875634068413568:12345-0@lo:5: 00002000:00080000:1.0:1788744161.121923:0:6682:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788744161.121926:0:6682:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788744161.123390:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7938:x1875634068413568:12345-0@lo:5: Request processed in 1490us (1621us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788744161.123399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788744161.123441:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af6e2e680 x1875634068413568/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744161.123456:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413568:0@lo:5: 00000004:00080000:1.0:1788744161.123468:0:7938:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788744161.123526:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3767b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413696:0@lo:700: 00000100:00100000:1.0:1788744161.123568:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744161.123594:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac5372d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744161.125349:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413696 00000100:00100000:3.0:1788744161.125360:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413696 00000100:00100000:3.0:1788744161.125404:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744161.125420:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7938:x1875634068413696:12345-0@lo:700: 00000100:00100000:3.0:1788744161.125458:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875634068413824:0@lo:700: 00000100:00100000:3.0:1788744161.125498:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744161.125519:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744161.125537:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413824 00000100:00100000:3.0:1788744161.125540:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413824 00000100:00100000:3.0:1788744161.125586:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744161.125592:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875634068413824:12345-0@lo:700: 00000004:00080000:2.0:1788744161.225125:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788744161.364994:0:5843:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788744161.384220:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8177480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6688:x1875634068413824:12345-0@lo:700: Request processed in 258617us (258711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744161.384239:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744161.384372:0:6688:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8175180 x1875634068413824/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788744177 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744161.384388:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6688:1875634068413824:0@lo:700: 40000000:02000000:3.0:1788744161.384401:0:6688:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788744161.549299:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788744161.549317:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788744161.550123:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7938:x1875634068413696:12345-0@lo:700: Request processed in 424692us (426542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744161.550136:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744161.552018:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9409c3767b80 x1875634068413696/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788744177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744161.552032:0:7938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788744161.552054:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3767b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413696:0@lo:700: 00000004:02000040:2.0:1788744161.594616:0:7938:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788744161.616766:0:7938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413952:0@lo:5: 00000100:00100000:3.0:1788744161.616829:0:7938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744161.616880:0:7938:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744161.617197:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068413952 00000100:00100000:1.0:1788744161.617204:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068413952 00000100:00100000:1.0:1788744161.617257:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744161.617265:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7938:x1875634068413952:12345-0@lo:5: 00002000:00080000:1.0:1788744161.628660:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788744161.628688:0:6681:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788744161.637019:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7938:x1875634068413952:12345-0@lo:5: Request processed in 19747us (20181us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788744161.637046:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788744161.637460:0:7938:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8175180 x1875634068413952/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788744177 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744161.637478:0:7938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7938:1875634068413952:0@lo:5: 00000004:00080000:2.0:1788744161.637492:0:7938:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788744161.949444:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744162.203445:0:7986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788744162.332181:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744162.332203:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068414080:0@lo:13: 00000100:00100000:2.0:1788744162.332266:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744162.332387:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414080 00000100:00100000:1.0:1788744162.332394:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414080 00000100:00100000:1.0:1788744162.332452:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744162.332461:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068414080:12345-0@lo:13: 00002000:00000024:1.0:1788744162.332492:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744162.332532:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068414080:12345-0@lo:13: Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744162.332539:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788744162.332590:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad050a680 x1875634068414080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744162.332608:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068414080:0@lo:13: 00000100:00080000:2.0:1788744162.334073:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788744162.973119:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744163.996794:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744165.018959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744166.043258:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744166.427369:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068414336:0@lo:400: 00000100:00100000:3.0:1788744166.427452:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427506:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068414848:0@lo:400: 00000100:00100000:3.0:1788744166.427533:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427598:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788744166.427605:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068414208:0@lo:400: 00000100:00100000:3.0:1788744166.427646:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427671:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068414720:0@lo:400: 00000100:00100000:3.0:1788744166.427713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427742:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068414464:0@lo:400: 00000100:00100000:3.0:1788744166.427765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744166.427790:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068414592:0@lo:400: 00000100:00100000:3.0:1788744166.427809:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744166.427844:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414336 00000100:00100000:3.0:1788744166.427854:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414336 00000100:00100000:3.0:1788744166.427914:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414720 00000100:00100000:3.0:1788744166.427918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414720 00000100:00100000:3.0:1788744166.427948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414464 00000100:00100000:3.0:1788744166.427951:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414464 00000100:00100000:3.0:1788744166.427967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744166.427977:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068414336:12345-0@lo:400: 00000100:00100000:3.0:1788744166.428039:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068414336:12345-0@lo:400: Request processed in 63us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.428046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788744166.428064:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744166.428069:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068414720:12345-0@lo:400: 00000100:00100000:3.0:1788744166.431567:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068414720:12345-0@lo:400: Request processed in 3471us (3826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.431584:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788744166.452117:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414848 00000100:00100000:3.0:1788744166.452135:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414848 00000100:00100000:3.0:1788744166.453712:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414592 00000100:00100000:3.0:1788744166.453726:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414592 00000100:00100000:3.0:1788744166.453792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744166.453805:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068414848:12345-0@lo:400: 00000100:00100000:3.0:1788744166.453933:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068414848:12345-0@lo:400: Request processed in 132us (26398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.453941:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744166.453957:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744166.453963:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068414592:12345-0@lo:400: 00000100:00100000:3.0:1788744166.453992:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068414592:12345-0@lo:400: Request processed in 30us (26182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.453998:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744166.454028:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414208 00000100:00100000:3.0:1788744166.454032:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414208 00000100:00100000:3.0:1788744166.454067:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744166.454073:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068414208:12345-0@lo:400: 00000100:00100000:3.0:1788744166.454100:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068414208:12345-0@lo:400: Request processed in 29us (26454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.454106:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788744166.454136:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744166.454144:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068414464:12345-0@lo:400: 00000100:00100000:3.0:1788744166.454174:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8177b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068414464:12345-0@lo:400: Request processed in 32us (26408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744166.454179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788744166.454228:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744166.454233:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744166.454236:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744166.460599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744166.460631:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068414976:0@lo:13: 00000100:00100000:0.0:1788744166.460715:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744166.460760:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068414976 00000100:00100000:1.0:1788744166.460784:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068414976 00010000:00080000:0.0:1788744166.460830:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8175c00 x1875634068414592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744166.460848:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068414592:0@lo:400: 00000100:00100000:1.0:1788744166.460856:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788744166.460875:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8174000 x1875634068414464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744166.460877:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068414976:12345-0@lo:13: 00000100:00100000:0.0:1788744166.460893:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8174000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068414464:0@lo:400: 00002000:00000024:1.0:1788744166.460934:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744166.460946:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068414208:0@lo:400: 00010000:00080000:0.0:1788744166.460962:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8175500 x1875634068414720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744166.460973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068414720:0@lo:400: 00010000:00080000:0.0:1788744166.460991:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8176d80 x1875634068414336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744166.460998:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068414976:12345-0@lo:13: Request processed in 131us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744166.461006:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068414336:0@lo:400: 00000100:00100000:1.0:1788744166.461013:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788744166.461086:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8176300 x1875634068414848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744166.461096:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8176300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068414848:0@lo:400: 00010000:00080000:1.0:1788744166.462085:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0509c00 x1875634068414976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744166.462111:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068414976:0@lo:13: 00000001:00080000:1.0:1788744166.570454:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788744167.067223:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744167.452590:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068415104:0@lo:13: 00000100:00100000:3.0:1788744167.452680:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744167.454476:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415104 00000100:00100000:1.0:1788744167.454489:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415104 00000100:00100000:1.0:1788744167.454543:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744167.454576:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068415104:12345-0@lo:13: 00002000:00000024:1.0:1788744167.455085:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744167.455179:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068415104:12345-0@lo:13: Request processed in 606us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744167.455187:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788744167.455291:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0508700 x1875634068415104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744167.455318:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068415104:0@lo:13: 00010000:00010000:3.0:1788744168.092871:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744169.119319:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744169.580889:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.580976:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047418496 00000100:00100000:0.0:1788744169.580988:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047418496 00000100:00100000:0.0:1788744169.581037:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:0.0:1788744169.581046:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1875634047418496:12345-192.168.204.56@tcp:250: 00010000:00080000:0.0:1788744169.581086:0:5830:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 5ce62f61-9f0c-4e8b-869e-d738743a7119@192.168.204.56@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:0.0:1788744169.581118:0:5830:0:(genops.c:1384:class_connect()) connect: client 5ce62f61-9f0c-4e8b-869e-d738743a7119, cookie 0x7cd2bfd5e1b945dd 00000100:00080000:0.0:1788744169.581276:0:5830:0:(import.c:65:import_set_state_nolock()) ffff940b004f6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744169.581358:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+5:2350:x1875634047418496:12345-192.168.204.56@tcp:250: Request processed in 311us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.581367:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:3.0:1788744169.613412:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744169.613871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047418624 00000100:00100000:1.0:1788744169.613884:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047418624 00000100:00100000:1.0:1788744169.615858:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:1.0:1788744169.615875:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+5:5581:x1875634047418624:12345-192.168.204.56@tcp:101: 00010000:00010000:1.0:1788744169.615893:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744169.615927:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761047 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744169.615957:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744169.615968:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744169.615976:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164e200, rc 0) 00000100:00100000:1.0:1788744169.616046:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+6:5581:x1875634047418624:12345-192.168.204.56@tcp:101: Request processed in 178us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744169.616053:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:1.0:1788744169.631981:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744169.632131:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047418752 00000100:00100000:3.0:1788744169.632141:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047418752 00000100:00100000:3.0:1788744169.632197:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 116 00000100:00100000:3.0:1788744169.632208:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+6:5581:x1875634047418752:12345-192.168.204.56@tcp:501: 00000100:00100000:3.0:1788744169.632514:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+6:5581:x1875634047418752:12345-192.168.204.56@tcp:501: Request processed in 307us (545us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744169.632522:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 116 00000100:00100000:3.0:1788744169.640054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744169.640100:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047418880 00000100:00100000:3.0:1788744169.640110:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047418880 00000100:00100000:3.0:1788744169.640161:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:3.0:1788744169.640173:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+6:5581:x1875634047418880:12345-192.168.204.56@tcp:101: 00010000:00010000:3.0:1788744169.640191:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744169.640209:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576104e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744169.640241:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744169.640254:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744169.640264:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744169.640338:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+7:5581:x1875634047418880:12345-192.168.204.56@tcp:101: Request processed in 167us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744169.640347:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:2.0:1788744169.646334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744169.648291:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419008 00000100:00100000:3.0:1788744169.648309:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419008 00000100:00100000:3.0:1788744169.648376:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:3.0:1788744169.648387:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+7:5581:x1875634047419008:12345-192.168.204.56@tcp:501: 00000100:00100000:3.0:1788744169.652272:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5581:x1875634047419008:12345-192.168.204.56@tcp:501: Request processed in 3872us (5934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744169.652288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:0.0:1788744169.663255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.663296:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419136 00000100:00100000:0.0:1788744169.663321:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419136 00000100:00100000:0.0:1788744169.663368:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 119 00000100:00100000:0.0:1788744169.663379:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5581:x1875634047419136:12345-192.168.204.56@tcp:503: 00000100:00100000:0.0:1788744169.663696:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5581:x1875634047419136:12345-192.168.204.56@tcp:503: Request processed in 317us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.663705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 119 00000100:00100000:3.0:1788744169.673868:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744169.675777:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419264 00000100:00100000:2.0:1788744169.675796:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419264 00000100:00100000:2.0:1788744169.675891:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:2.0:1788744169.675903:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5599:x1875634047419264:12345-192.168.204.56@tcp:502: 00000100:00100000:2.0:1788744169.676306:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5599:x1875634047419264:12345-192.168.204.56@tcp:502: Request processed in 403us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744169.676315:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:3.0:1788744169.724287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.724396:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419392 00000100:00100000:0.0:1788744169.724407:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419392 00000100:00100000:0.0:1788744169.725221:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 121 00000100:00100000:0.0:1788744169.725236:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5599:x1875634047419392:12345-192.168.204.56@tcp:502: 00000100:00100000:0.0:1788744169.727010:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5599:x1875634047419392:12345-192.168.204.56@tcp:502: Request processed in 1771us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.727022:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 121 00000100:00100000:3.0:1788744169.741647:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.741995:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419520 00000100:00100000:0.0:1788744169.742006:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419520 00000100:00100000:0.0:1788744169.742064:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:0.0:1788744169.742075:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5581:x1875634047419520:12345-192.168.204.56@tcp:101: 00010000:00010000:0.0:1788744169.742095:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744169.742197:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7297c00/0x7cd2bfd5e1b945f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761078 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744169.742235:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7297c00/0x7cd2bfd5e1b945f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761078 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744169.742249:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7297c00/0x7cd2bfd5e1b945f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761078 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744169.742259:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297c00, rc 0) 00000100:00100000:0.0:1788744169.742344:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5581:x1875634047419520:12345-192.168.204.56@tcp:101: Request processed in 269us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.742351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:3.0:1788744169.745141:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.745330:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419648 00000100:00100000:0.0:1788744169.745341:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419648 00000100:00100000:0.0:1788744169.745390:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00100000:0.0:1788744169.745401:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5581:x1875634047419648:12345-192.168.204.56@tcp:256: 20000000:01000000:0.0:1788744169.749415:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788744169.749451:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788744169.749456:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788744169.749459:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788744169.749461:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788744169.756520:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5581:x1875634047419648:12345-192.168.204.56@tcp:256: Request processed in 11109us (11378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744169.756537:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00100000:3.0:1788744169.762372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744169.762578:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419776 00000100:00100000:2.0:1788744169.762589:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419776 00000100:00100000:2.0:1788744169.762637:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 124 00000100:00100000:2.0:1788744169.762647:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5581:x1875634047419776:12345-192.168.204.56@tcp:101: 00010000:00010000:2.0:1788744169.762664:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744169.762682:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576107f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744169.762738:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744169.762749:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744169.762758:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744169.762823:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5581:x1875634047419776:12345-192.168.204.56@tcp:101: Request processed in 177us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744169.762830:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 124 00000100:00100000:2.0:1788744169.770402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.772817:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047419904 00000100:00100000:0.0:1788744169.772831:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047419904 00000100:00100000:0.0:1788744169.772907:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 125 00000100:00100000:0.0:1788744169.772917:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5581:x1875634047419904:12345-192.168.204.56@tcp:501: 00000100:00100000:0.0:1788744169.773224:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5581:x1875634047419904:12345-192.168.204.56@tcp:501: Request processed in 307us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.773231:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 125 00000100:00100000:3.0:1788744169.778182:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744169.781722:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420032 00000100:00100000:0.0:1788744169.781738:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420032 00000100:00100000:0.0:1788744169.781836:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 126 00000100:00100000:0.0:1788744169.781847:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5581:x1875634047420032:12345-192.168.204.56@tcp:503: 00000100:00100000:0.0:1788744169.782287:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5581:x1875634047420032:12345-192.168.204.56@tcp:503: Request processed in 440us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744169.782296:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 126 00000100:00100000:0.0:1788744169.811435:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744169.811688:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420160 00000100:00100000:2.0:1788744169.811698:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420160 00000100:00100000:2.0:1788744169.811748:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 127 00000100:00100000:2.0:1788744169.811761:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5603:x1875634047420160:12345-192.168.204.56@tcp:502: 00000100:00100000:2.0:1788744169.812076:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5603:x1875634047420160:12345-192.168.204.56@tcp:502: Request processed in 318us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744169.812085:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 127 00000100:00100000:0.0:1788744169.818785:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744169.820047:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420288 00000100:00100000:2.0:1788744169.820059:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420288 00000100:00100000:2.0:1788744169.820108:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00100000:2.0:1788744169.820118:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5603:x1875634047420288:12345-192.168.204.56@tcp:502: 00000100:00100000:2.0:1788744169.820763:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5603:x1875634047420288:12345-192.168.204.56@tcp:502: Request processed in 643us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744169.820773:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00100000:1.0:1788744169.845016:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744169.845064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420416 00000100:00100000:1.0:1788744169.845074:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420416 00000100:00100000:1.0:1788744169.845115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:1.0:1788744169.845123:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1875634047420416:12345-192.168.204.56@tcp:38: 00010000:00080000:1.0:1788744169.845151:0:5837:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788744169.845215:0:5837:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b94600 00000004:00100000:1.0:1788744169.845249:0:5837:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788744169.845256:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1788744169.915454:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9409c2131000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744169.915947:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047420416:12345-192.168.204.56@tcp:38: Request processed in 70821us (70939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744169.915975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00010000:00010000:3.0:1788744170.142910:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744170.931093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744170.936506:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420544 00000100:00100000:1.0:1788744170.936522:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420544 00000100:00100000:1.0:1788744170.938071:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:1.0:1788744170.938085:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:0:x1875634047420544:12345-192.168.204.56@tcp:41: 00000004:00000024:1.0:1788744170.938134:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788744170.938225:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:0:x1875634047420544:12345-192.168.204.56@tcp:41: Request processed in 144us (7141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744170.938233:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00080000:3.0:1788744170.940486:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744170.942418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744170.945592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420672 00000100:00100000:1.0:1788744170.945609:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420672 00000100:00100000:1.0:1788744170.945689:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:1.0:1788744170.945699:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047420672:12345-192.168.204.56@tcp:41: 00000004:00000024:1.0:1788744170.945731:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788744170.945815:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047420672:12345-192.168.204.56@tcp:41: Request processed in 117us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744170.945823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:2.0:1788744170.953913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744170.954048:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420800 00000100:00100000:1.0:1788744170.954059:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420800 00000100:00100000:1.0:1788744170.954123:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:1.0:1788744170.954135:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047420800:12345-192.168.204.56@tcp:40: 00000100:00100000:1.0:1788744170.954229:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047420800:12345-192.168.204.56@tcp:40: Request processed in 96us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744170.954236:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:0.0:1788744170.961059:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744170.961104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744170.961141:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744170.965025:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047420928 00000100:00100000:1.0:1788744170.965056:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047420928 00000100:00100000:1.0:1788744170.965169:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421056 00000100:00100000:1.0:1788744170.965173:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421056 00000100:00100000:2.0:1788744170.965270:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421184 00000100:00100000:2.0:1788744170.965274:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421184 00000100:00100000:2.0:1788744170.965321:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:2.0:1788744170.965331:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047421184:12345-192.168.204.56@tcp:33: 00000100:00100000:0.0:1788744170.968910:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:0.0:1788744170.968925:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875634047420928:12345-192.168.204.56@tcp:8: 00010000:00080000:0.0:1788744170.968965:0:6681:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1788744170.969003:0:6681:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b94607 00002000:00100000:0.0:1788744170.969017:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03c88f08-96bd-4666-9af8-74d11f561443/ffff940b004f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744170.969045:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744170.969393:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788744170.969426:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940b004f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744170.969494:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047420928:12345-192.168.204.56@tcp:8: Request processed in 570us (8444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744170.969502:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:0.0:1788744170.969522:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:0.0:1788744170.969527:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875634047421056:12345-192.168.204.56@tcp:8: 00010000:00080000:0.0:1788744170.969542:0:6681:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1788744170.969574:0:6681:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b9460e 00002000:00100000:0.0:1788744170.969580:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03c88f08-96bd-4666-9af8-74d11f561443/ffff940b004f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788744170.969594:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788744170.969792:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788744170.969807:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940b004f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744170.969829:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047421056:12345-192.168.204.56@tcp:8: Request processed in 301us (8687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744170.969849:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:1.0:1788744170.978266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744170.979657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421312 00000100:00100000:3.0:1788744170.979669:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421312 00000100:00100000:3.0:1788744170.979731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 129 00000100:00100000:3.0:1788744170.979742:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047421312:12345-192.168.204.56@tcp:400: 00000100:00100000:3.0:1788744170.979825:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047421312:12345-192.168.204.56@tcp:400: Request processed in 85us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744170.979833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 129 00000004:00080000:3.0:1788744171.008476:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 43063us 00000004:00200000:2.0:1788744171.043095:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744171.043230:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:5581:x1875634047421184:12345-192.168.204.56@tcp:33: Request processed in 77894us (82119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744171.043241:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00010000:00010000:0.0:1788744171.162734:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744171.471862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744171.472115:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421440 00000100:00100000:3.0:1788744171.472126:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421440 00000100:00100000:3.0:1788744171.472188:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744171.472199:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:5620:x1875634047421440:12345-192.168.204.56@tcp:101: 00010000:00010000:3.0:1788744171.472220:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744171.472248:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fd400/0x7cd2bfd5e1b94615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610a9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472318:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472332:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472345:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744171.472400:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744171.472404:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744171.472422:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472446:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fd400/0x7cd2bfd5e1b94615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610a9 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472465:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610a9 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744171.472473:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:3.0:1788744171.472486:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744171.472489:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fde00, rc 0) 00000100:00100000:3.0:1788744171.472543:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:5620:x1875634047421440:12345-192.168.204.56@tcp:101: Request processed in 347us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744171.472596:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744171.547630:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744171.547659:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068415232:0@lo:13: 00000100:00100000:3.0:1788744171.547733:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548113:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068415616:0@lo:400: 00000100:00100000:2.0:1788744171.548170:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548197:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744171.548203:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068415488:0@lo:400: 00000100:00100000:2.0:1788744171.548224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548252:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415616 00000100:00100000:2.0:1788744171.548260:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415616 00000100:00100000:2.0:1788744171.548310:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415488 00000100:00100000:2.0:1788744171.548314:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415488 00000100:00100000:2.0:1788744171.548333:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744171.548341:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068415616:12345-0@lo:400: 00000100:00100000:2.0:1788744171.548401:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068415616:12345-0@lo:400: Request processed in 60us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744171.548408:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744171.548425:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744171.548431:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068415488:12345-0@lo:400: 00000100:00100000:2.0:1788744171.548458:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068415488:12345-0@lo:400: Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744171.548473:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744171.548492:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068415744:0@lo:400: 00000100:00100000:2.0:1788744171.548523:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548544:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788744171.548580:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068415360:0@lo:400: 00000100:00100000:2.0:1788744171.548609:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548633:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068415872:0@lo:400: 00000100:00100000:2.0:1788744171.548654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744171.548681:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415744 00000100:00100000:2.0:1788744171.548685:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415744 00000100:00100000:2.0:1788744171.548714:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744171.548720:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068415744:12345-0@lo:400: 00000100:00100000:2.0:1788744171.548753:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068415744:12345-0@lo:400: Request processed in 33us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744171.548758:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744171.548786:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415360 00000100:00100000:1.0:1788744171.548964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415872 00000100:00100000:1.0:1788744171.548969:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415872 00000100:00100000:1.0:1788744171.548991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744171.548996:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068415872:12345-0@lo:400: 00000100:00100000:1.0:1788744171.549029:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068415872:12345-0@lo:400: Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744171.549035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788744171.549051:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744171.549056:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744171.549083:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068415488:0@lo:400: 00000100:00100000:1.0:1788744171.549095:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0508700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068415616:0@lo:400: 00000100:00100000:3.0:1788744171.549333:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068415872:0@lo:400: 00010000:00080000:3.0:1788744171.549345:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0509c00 x1875634068415744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744171.549355:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068415744:0@lo:400: 00000100:00100000:0.0:1788744171.549482:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068415232 00000100:00100000:0.0:1788744171.549487:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415232 00000100:00100000:0.0:1788744171.549538:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744171.549545:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068415232:12345-0@lo:13: 00002000:00000024:0.0:1788744171.549581:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744171.549622:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068415232:12345-0@lo:13: Request processed in 78us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744171.549628:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788744171.549663:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace16ce00 x1875634068415232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744171.549672:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788744171.549688:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068415232:0@lo:13: 00000100:00100000:2.0:1788744171.550035:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068415360 00000100:00100000:2.0:1788744171.550077:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744171.550085:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068415360:12345-0@lo:400: 00000100:00100000:2.0:1788744171.550124:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068415360:12345-0@lo:400: Request processed in 40us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744171.550130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744171.550163:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068415360:0@lo:400: 00000100:00080000:1.0:1788744171.550898:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788744172.188200:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744172.576792:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068416000:0@lo:13: 00000100:00100000:0.0:1788744172.576866:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744172.578883:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416000 00000100:00100000:2.0:1788744172.581640:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416000 00000100:00100000:2.0:1788744172.581717:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744172.581745:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068416000:12345-0@lo:13: 00002000:00000024:2.0:1788744172.581785:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744172.581873:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068416000:12345-0@lo:13: Request processed in 131us (5006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744172.581880:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788744172.584294:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aff938380 x1875634068416000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744172.584322:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068416000:0@lo:13: 00010000:00010000:0.0:1788744173.211872:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744174.238799:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744174.397867:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744174.398181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421568 00000100:00100000:2.0:1788744174.398193:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421568 00000100:00100000:2.0:1788744174.398281:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744174.398293:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:5673:x1875634047421568:12345-192.168.204.56@tcp:41: 00000004:00000024:2.0:1788744174.398337:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788744174.398423:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:5673:x1875634047421568:12345-192.168.204.56@tcp:41: Request processed in 132us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744174.398430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00080000:1.0:1788744174.399287:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744174.408505:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744174.408692:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421696 00000100:00100000:2.0:1788744174.408702:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421696 00000100:00100000:2.0:1788744174.408784:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744174.408795:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03c88f08-96bd-4666-9af8-74d11f561443+6:5673:x1875634047421696:12345-192.168.204.56@tcp:13: 00002000:00000024:2.0:1788744174.408845:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744174.408919:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03c88f08-96bd-4666-9af8-74d11f561443+6:5673:x1875634047421696:12345-192.168.204.56@tcp:13: Request processed in 125us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744174.408927:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00080000:1.0:1788744174.409013:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744174.417373:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744174.417833:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421824 00000100:00100000:2.0:1788744174.417844:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421824 00000100:00100000:2.0:1788744174.417929:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:2.0:1788744174.417940:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03c88f08-96bd-4666-9af8-74d11f561443+6:5673:x1875634047421824:12345-192.168.204.56@tcp:13: 00002000:00000024:2.0:1788744174.417978:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744174.418066:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03c88f08-96bd-4666-9af8-74d11f561443+6:5673:x1875634047421824:12345-192.168.204.56@tcp:13: Request processed in 128us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744174.418074:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00080000:1.0:1788744174.419615:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788744175.260818:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744175.260872:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000001:00100000:1.0:1788744175.268642:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000001:00100000:3.0:1788744175.786448:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000100:00100000:1.0:1788744176.109052:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744176.109097:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744176.109127:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744176.109158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744176.109188:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422080 00000100:00100000:1.0:1788744176.109210:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422080 00000100:00100000:1.0:1788744176.109269:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:1.0:1788744176.109279:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047422080:12345-192.168.204.56@tcp:400: 00000100:00100000:1.0:1788744176.109353:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047422080:12345-192.168.204.56@tcp:400: Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.109361:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:1.0:1788744176.109384:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422208 00000100:00100000:1.0:1788744176.109388:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422208 00000100:00100000:1.0:1788744176.109411:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422336 00000100:00100000:1.0:1788744176.109414:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422336 00000100:00100000:1.0:1788744176.109431:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:1.0:1788744176.109437:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422208:12345-192.168.204.56@tcp:400: 00000100:00100000:1.0:1788744176.109465:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422208:12345-192.168.204.56@tcp:400: Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.109471:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:1.0:1788744176.109483:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:1.0:1788744176.109489:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422336:12345-192.168.204.56@tcp:400: 00000100:00100000:1.0:1788744176.109509:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422336:12345-192.168.204.56@tcp:400: Request processed in 21us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.109514:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00080000:1.0:1788744176.109528:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744176.109532:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744176.109535:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744176.112499:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047421952 00000100:00100000:3.0:1788744176.112511:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047421952 00000100:00100000:3.0:1788744176.112676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 131 00000100:00100000:3.0:1788744176.112697:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047421952:12345-192.168.204.56@tcp:400: 00000100:00100000:3.0:1788744176.113022:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047421952:12345-192.168.204.56@tcp:400: Request processed in 74us (3727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744176.113033:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 131 00010000:00010000:2.0:1788744176.282773:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744176.666876:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068416128:0@lo:13: 00000100:00100000:1.0:1788744176.666947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744176.667338:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068416512:0@lo:400: 00000100:00100000:1.0:1788744176.667382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744176.667400:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744176.667406:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068416640:0@lo:400: 00000100:00100000:1.0:1788744176.667429:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744176.667465:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416640 00000100:00100000:1.0:1788744176.667473:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416640 00000100:00100000:1.0:1788744176.667533:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788744176.667543:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068416640:12345-0@lo:400: 00000100:00100000:1.0:1788744176.667633:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068416640:12345-0@lo:400: Request processed in 91us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.667641:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744176.667681:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068416384:0@lo:400: 00000100:00080000:1.0:1788744176.667681:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744176.667731:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9409c3766300 x1875634068416640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744176.667748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068416640:0@lo:400: 00000100:00100000:3.0:1788744176.667772:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744176.667816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416512 00000100:00100000:1.0:1788744176.667821:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416512 00000100:00100000:3.0:1788744176.667833:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788744176.667858:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416384 00000100:00100000:3.0:1788744176.667860:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068416256:0@lo:400: 00000100:00100000:1.0:1788744176.667864:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416384 00000100:00100000:1.0:1788744176.667897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744176.667909:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068416512:12345-0@lo:400: 00000100:00100000:3.0:1788744176.667920:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744176.667969:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068416768:0@lo:400: 00000100:00100000:1.0:1788744176.667978:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068416512:12345-0@lo:400: Request processed in 72us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.667985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744176.668004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744176.668014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744176.668023:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068416384:12345-0@lo:400: 00000100:00100000:1.0:1788744176.668075:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068416384:12345-0@lo:400: Request processed in 58us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744176.668090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744176.668100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416768 00000100:00100000:3.0:1788744176.668109:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416768 00000100:00080000:1.0:1788744176.668114:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744176.668145:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068416512:0@lo:400: 00000100:00080000:1.0:1788744176.668170:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744176.668178:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744176.668191:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068416768:12345-0@lo:400: 00000100:00100000:1.0:1788744176.668198:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068416384:0@lo:400: 00000100:00100000:3.0:1788744176.668264:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068416768:12345-0@lo:400: Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744176.668273:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744176.668302:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068416768:0@lo:400: 00000100:00100000:0.0:1788744176.668545:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416128 00000100:00100000:0.0:1788744176.668577:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416128 00000100:00100000:0.0:1788744176.668616:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744176.668624:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068416128:12345-0@lo:13: 00002000:00000024:0.0:1788744176.668661:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744176.668730:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068416128:12345-0@lo:13: Request processed in 107us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744176.668737:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744176.668762:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416256 00000100:00100000:0.0:1788744176.668766:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416256 00000100:00100000:0.0:1788744176.668788:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788744176.668794:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068416256:12345-0@lo:400: 00000100:00100000:0.0:1788744176.668827:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068416256:12345-0@lo:400: Request processed in 33us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744176.668833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1788744176.668870:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace16f480 x1875634068416128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744176.668885:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068416128:0@lo:13: 00000100:00100000:0.0:1788744176.668908:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068416256:0@lo:400: 00000100:00080000:1.0:1788744176.669042:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788744177.306849:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744177.699293:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068416896:0@lo:13: 00000100:00100000:0.0:1788744177.699372:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744177.701528:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068416896 00000100:00100000:1.0:1788744177.701542:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068416896 00000100:00100000:1.0:1788744177.701620:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744177.701630:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068416896:12345-0@lo:13: 00002000:00000024:1.0:1788744177.701678:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744177.706122:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068416896:12345-0@lo:13: Request processed in 4484us (6740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744177.706136:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788744177.711616:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aff938a80 x1875634068416896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744177.711648:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068416896:0@lo:13: 00010000:00010000:2.0:1788744178.331611:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744178.467164:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788744179.355589:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744180.387057:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744181.227445:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744181.227494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744181.227533:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744181.227596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744181.227624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422592 00000100:00100000:0.0:1788744181.227634:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422592 00000100:00100000:0.0:1788744181.227703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:0.0:1788744181.227714:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047422592:12345-192.168.204.56@tcp:400: 00000100:00100000:0.0:1788744181.227783:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047422592:12345-192.168.204.56@tcp:400: Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744181.227791:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:0.0:1788744181.227814:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422720 00000100:00100000:0.0:1788744181.227818:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422720 00000100:00100000:0.0:1788744181.227839:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422848 00000100:00100000:0.0:1788744181.227841:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422848 00000100:00100000:0.0:1788744181.227855:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744181.227862:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422720:12345-192.168.204.56@tcp:400: 00000100:00100000:0.0:1788744181.227888:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422720:12345-192.168.204.56@tcp:400: Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744181.227895:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744181.227906:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:0.0:1788744181.227912:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422848:12345-192.168.204.56@tcp:400: 00000100:00100000:0.0:1788744181.227934:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047422848:12345-192.168.204.56@tcp:400: Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744181.227940:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00080000:0.0:1788744181.227955:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744181.227958:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744181.227960:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744181.230787:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422464 00000100:00100000:2.0:1788744181.230804:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422464 00000100:00100000:2.0:1788744181.230878:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 133 00000100:00100000:2.0:1788744181.230889:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047422464:12345-192.168.204.56@tcp:400: 00000100:00100000:2.0:1788744181.230960:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047422464:12345-192.168.204.56@tcp:400: Request processed in 73us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.230967:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 133 00010000:00010000:0.0:1788744181.413082:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744181.786926:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068417152:0@lo:400: 00000100:00100000:0.0:1788744181.786999:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744181.787079:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068417664:0@lo:400: 00000100:00100000:0.0:1788744181.787105:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744181.787135:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788744181.787142:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068417024:0@lo:400: 00000100:00100000:2.0:1788744181.787281:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068417408:0@lo:400: 00000100:00100000:2.0:1788744181.787311:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744181.787332:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788744181.787339:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068417280:0@lo:400: 00000100:00100000:2.0:1788744181.787360:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744181.787378:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068417792:0@lo:13: 00000100:00100000:2.0:1788744181.787399:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744181.787445:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417152 00000100:00100000:2.0:1788744181.787454:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417152 00000100:00100000:2.0:1788744181.787497:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417280 00000100:00100000:2.0:1788744181.787501:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417280 00000100:00100000:2.0:1788744181.787531:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744181.787540:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068417152:12345-0@lo:400: 00000100:00100000:2.0:1788744181.787614:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068417152:12345-0@lo:400: Request processed in 75us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.787631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744181.787648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744181.787654:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068417280:12345-0@lo:400: 00000100:00100000:2.0:1788744181.787688:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068417280:12345-0@lo:400: Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.787693:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744181.787711:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417792 00000100:00100000:2.0:1788744181.787715:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417792 00000100:00100000:2.0:1788744181.787741:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744181.787747:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068417792:12345-0@lo:13: 00002000:00000024:2.0:1788744181.787774:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744181.787804:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068417792:12345-0@lo:13: Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.787810:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788744181.787844:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068417280:0@lo:400: 00010000:00080000:2.0:1788744181.787857:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aff93b100 x1875634068417792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744181.787872:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068417792:0@lo:13: 00000100:00100000:2.0:1788744181.787909:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417664 00000100:00100000:2.0:1788744181.787913:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417664 00000100:00100000:2.0:1788744181.787935:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417408 00000100:00100000:2.0:1788744181.787938:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417408 00000100:00100000:2.0:1788744181.787954:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744181.787960:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068417664:12345-0@lo:400: 00000100:00100000:2.0:1788744181.787990:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068417664:12345-0@lo:400: Request processed in 31us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.788002:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744181.788015:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788744181.788020:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068417408:12345-0@lo:400: 00000100:00100000:2.0:1788744181.788050:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068417408:12345-0@lo:400: Request processed in 30us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.788056:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788744181.788084:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8178700 x1875634068417408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744181.788095:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8178700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068417408:0@lo:400: 00000100:00080000:2.0:1788744181.788119:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744181.788124:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744181.788126:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744181.788634:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744181.788712:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068417536:0@lo:400: 00000100:00100000:0.0:1788744181.788739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744181.788771:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068417152:0@lo:400: 00010000:00080000:0.0:1788744181.788783:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8178000 x1875634068417664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744181.788792:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8178000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068417664:0@lo:400: 00000100:00100000:2.0:1788744181.790444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417536 00000100:00100000:2.0:1788744181.790455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417536 00000100:00100000:2.0:1788744181.790521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744181.790529:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068417536:12345-0@lo:400: 00000100:00100000:2.0:1788744181.790624:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068417536:12345-0@lo:400: Request processed in 96us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744181.790631:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788744181.790736:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744181.790762:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068417536:0@lo:400: 00000100:00100000:1.0:1788744181.791370:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417024 00000100:00100000:1.0:1788744181.791375:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417024 00000100:00100000:1.0:1788744181.791411:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788744181.791418:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068417024:12345-0@lo:400: 00000100:00100000:1.0:1788744181.791473:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068417024:12345-0@lo:400: Request processed in 56us (2840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744181.791479:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744181.791612:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068417024:0@lo:400: 00010000:00010000:0.0:1788744182.426829:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744182.812216:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744182.812244:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068417920:0@lo:13: 00000100:00100000:3.0:1788744182.812315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744182.812457:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068417920 00000100:00100000:0.0:1788744182.812465:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068417920 00000100:00100000:0.0:1788744182.812515:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744182.812525:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068417920:12345-0@lo:13: 00002000:00000024:0.0:1788744182.812587:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744182.812636:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068417920:12345-0@lo:13: Request processed in 112us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744182.812656:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788744182.812906:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad817ad80 x1875634068417920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744182.812924:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068417920:0@lo:13: 00000020:00000080:2.0:1788744183.084787:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffab4649e0 20000000:00000080:2.0:1788744183.084805:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940affde0c00 uarg=0000000000000000 20000000:01000000:2.0:1788744183.084841:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788744183.084843:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788744183.084846:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788744183.084850:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788744183.084854:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788744183.084867:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788744183.084875:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788744183.085296:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788744183.085299:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788744183.089843:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788744183.094772:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788744183.094827:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788744183.094880:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788744183.094896:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788744183.094899:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788744183.095820:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788744183.096203:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788744183.096266:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788744183.096303:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788744183.096325:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788744183.096328:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788744183.099253:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788744183.100328:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788744183.100396:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788744183.100436:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788744183.100450:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788744183.100452:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788744183.109226:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788744183.110023:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788744183.110085:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788744183.110124:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1788744183.110139:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788744183.110157:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110174:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110181:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110187:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110193:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110200:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110206:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110226:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110235:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110241:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110250:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110287:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110304:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 9 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.110318:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418048:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744183.110427:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110437:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 9 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.110446:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418176:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744183.110476:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110495:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 18 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.110504:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418304:0@lo:104: 00000100:00100000:2.0:1788744183.110542:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744183.110910:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.110919:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 18 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.110927:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff939180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418432:0@lo:104: 00000100:00100000:2.0:1788744183.110952:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744183.114918:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.114935:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 18 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.114949:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418560:0@lo:104: 00010000:00010000:2.0:1788744183.115006:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.115014:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 18 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.115022:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff939880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418688:0@lo:104: 00010000:00010000:2.0:1788744183.115044:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.115065:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 18 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.115093:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418816:0@lo:104: 00010000:00010000:2.0:1788744183.115119:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.115127:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 18 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.115134:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418944:0@lo:104: 00010000:00010000:2.0:1788744183.115158:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.115165:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 18 pid: 5829 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.115173:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068419072:0@lo:104: 00000100:00100000:2.0:1788744183.115190:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744183.126978:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418304 00000100:00100000:3.0:1788744183.126993:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418304 00000100:00100000:3.0:1788744183.127037:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418432 00000100:00100000:3.0:1788744183.127040:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418432 00000100:00100000:3.0:1788744183.127057:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744183.127065:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:8441:x1875634068418304:12345-0@lo:104: 00010000:00010000:3.0:1788744183.127106:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.127283:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418304:0@lo:104: 00000100:00100000:1.0:1788744183.127397:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744183.127435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744183.127456:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047422976 00000100:00100000:1.0:1788744183.127460:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047422976 00010000:00010000:1.0:1788744183.127482:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 10 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.127503:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423104 00000100:00100000:1.0:1788744183.127505:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423104 00010000:00010000:1.0:1788744183.127517:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 11 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.127534:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:1.0:1788744183.127541:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2354:x1875634047422976:12345-192.168.204.56@tcp:103: 00010000:00010000:1.0:1788744183.127625:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.127632:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 11 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.127643:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 11 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.127662:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.127700:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2354:x1875634047422976:12345-192.168.204.56@tcp:103: Request processed in 159us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.127707:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:1.0:1788744183.127724:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:1.0:1788744183.127730:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047423104:12345-192.168.204.56@tcp:103: 00010000:00010000:1.0:1788744183.127744:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.127748:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 10 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.127758:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 10 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.127768:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.127787:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047423104:12345-192.168.204.56@tcp:103: Request processed in 57us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.127792:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00010000:00010000:2.0:1788744183.127904:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b945eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576104e expref: 9 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.127916:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418048:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744183.127925:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b945e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761047 expref: 8 pid: 5828 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.127945:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418176:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744183.128646:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744183.128674:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744183.128702:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744183.128715:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744183.128724:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744183.128732:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744183.128744:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788744183.128749:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788744183.132269:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418560 00000100:00100000:2.0:1788744183.132284:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418560 00000100:00100000:2.0:1788744183.132332:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788744183.132341:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418688 00000100:00100000:2.0:1788744183.132344:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418688 00000100:00100000:2.0:1788744183.132355:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788744183.132358:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418816 00000100:00100000:2.0:1788744183.132361:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418816 00000100:00100000:2.0:1788744183.132368:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788744183.132371:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068418944 00000100:00100000:2.0:1788744183.132373:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068418944 00000100:00100000:2.0:1788744183.132380:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788744183.132383:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419072 00000100:00100000:2.0:1788744183.132385:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419072 00000100:00100000:0.0:1788744183.132863:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744183.132876:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00963c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:8441:x1875634068418432:12345-0@lo:104: 00010000:00010000:0.0:1788744183.132893:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744183.133121:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788744183.133130:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+9:8441:x1875634068418304:12345-0@lo:104: Request processed in 6065us (22586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744183.133138:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744183.133162:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744183.133169:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:8441:x1875634068418560:12345-0@lo:104: 00010000:00010000:3.0:1788744183.133177:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744183.133279:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff939180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418432:0@lo:104: 00000100:00100000:2.0:1788744183.133290:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418560:0@lo:104: 00010000:00010000:0.0:1788744183.136835:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788744183.136853:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00963c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+8:8441:x1875634068418432:12345-0@lo:104: Request processed in 3977us (25895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744183.136866:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744183.136951:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744183.136967:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+7:8441:x1875634068418688:12345-0@lo:104: 00010000:00010000:0.0:1788744183.136983:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.137203:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788744183.137210:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+7:8441:x1875634068418688:12345-0@lo:104: Request processed in 251us (8515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744183.137216:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744183.137245:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744183.137252:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:8441:x1875634068418816:12345-0@lo:104: 00010000:00010000:0.0:1788744183.137261:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.137294:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788744183.137299:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+6:8441:x1875634068418816:12345-0@lo:104: Request processed in 48us (8583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744183.137305:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744183.137318:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744183.137324:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:8441:x1875634068418944:12345-0@lo:104: 00010000:00010000:0.0:1788744183.137332:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.137357:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788744183.137361:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:8441:x1875634068418944:12345-0@lo:104: Request processed in 39us (8636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744183.137367:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744183.137378:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744183.137385:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:8441:x1875634068419072:12345-0@lo:104: 00010000:00010000:0.0:1788744183.137392:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.137417:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788744183.137421:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:8441:x1875634068419072:12345-0@lo:104: Request processed in 38us (8688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744183.137426:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788744183.137508:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788744183.137516:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137523:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.137527:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137535:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.137542:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.137573:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.137610:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137618:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.137784:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137792:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29ca200/0x7cd2bfd5e1b945cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945d6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137806:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788744183.137810:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137815:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.137818:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137824:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.137829:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.137833:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.137847:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137852:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.137856:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137862:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fc200/0x7cd2bfd5e1b945a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b945ac expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137871:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788744183.137878:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137883:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb400 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.137885:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137891:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.137896:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.137901:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.137914:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137919:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.137932:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137938:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29cb400/0x7cd2bfd5e1b94589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94590 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137947:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788744183.137949:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137954:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca800 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.137957:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.137972:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.137978:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.137983:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.137995:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138000:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.138005:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138010:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29ca800/0x7cd2bfd5e1b9457b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94582 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138018:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788744183.138021:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138025:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.138027:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138033:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.138039:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.138049:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.138061:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138066:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.138205:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138212:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0030200/0x7cd2bfd5e1b9456d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94574 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138221:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744183.138224:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138230:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cbe00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.138233:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138240:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.138246:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.138250:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.138264:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138270:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.138280:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138286:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29cbe00/0x7cd2bfd5e1b94543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9454a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138297:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744183.138299:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138304:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744183.138307:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138313:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744183.138319:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744183.138323:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744183.138336:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138342:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788744183.138345:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138351:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0030e00/0x7cd2bfd5e1b94519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94520 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.138363:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744183.138370:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744183.138373:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744183.138391:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419200:0@lo:103: 00000100:00100000:1.0:1788744183.138434:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.138474:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419712:0@lo:103: 00000100:00100000:1.0:1788744183.138494:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.138513:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744183.138518:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419328:0@lo:103: 00000100:00100000:1.0:1788744183.138536:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.138583:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419840:0@lo:103: 00000100:00100000:1.0:1788744183.138604:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.138629:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419456:0@lo:103: 00000100:00100000:1.0:1788744183.139869:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.139901:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419968:0@lo:103: 00000100:00100000:1.0:1788744183.139926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.139942:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744183.139947:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419584:0@lo:103: 00000100:00100000:1.0:1788744183.139967:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744183.139994:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419200 00000100:00100000:1.0:1788744183.140002:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419200 00010000:00010000:1.0:1788744183.140030:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 19 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140050:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419712 00000100:00100000:1.0:1788744183.140053:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419712 00010000:00010000:1.0:1788744183.140063:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 20 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140847:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419328 00000100:00100000:1.0:1788744183.140852:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419328 00010000:00010000:1.0:1788744183.140869:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 21 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140879:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419840 00000100:00100000:1.0:1788744183.140881:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419840 00010000:00010000:1.0:1788744183.140890:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 22 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140898:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419456 00000100:00100000:1.0:1788744183.140900:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419456 00010000:00010000:1.0:1788744183.140909:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 23 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140917:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419968 00000100:00100000:1.0:1788744183.140919:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419968 00010000:00010000:1.0:1788744183.140926:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 24 pid: 5829 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140933:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068419584 00000100:00100000:1.0:1788744183.140936:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068419584 00010000:00010000:1.0:1788744183.140945:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 25 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744183.140956:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744183.140963:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+25:3312:x1875634068419200:12345-0@lo:103: 00010000:00010000:1.0:1788744183.140977:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.140982:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 25 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141004:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 25 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141019:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac0031a00/0x7cd2bfd5e1b945d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945cf expref: 25 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141034:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141153:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+24:3312:x1875634068419200:12345-0@lo:103: Request processed in 189us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141160:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744183.141178:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744183.141184:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+23:3312:x1875634068419712:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141194:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141198:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 23 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141206:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 23 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141215:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141237:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+23:3312:x1875634068419712:12345-0@lo:103: Request processed in 54us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141243:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744183.141255:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744183.141261:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+22:3312:x1875634068419328:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141268:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141271:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 22 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141288:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 22 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141297:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac0031600/0x7cd2bfd5e1b945ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b945a5 expref: 22 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141304:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141326:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+21:3312:x1875634068419328:12345-0@lo:103: Request processed in 66us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141331:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744183.141342:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744183.141347:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3312:x1875634068419840:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141355:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141358:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 20 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141366:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 20 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141375:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141395:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3312:x1875634068419840:12345-0@lo:103: Request processed in 48us (2791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141400:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788744183.141411:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744183.141417:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068419456:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141424:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141428:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 19 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141441:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 19 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141450:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac0031e00/0x7cd2bfd5e1b94590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94589 expref: 19 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141458:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141492:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:3310:x1875634068419456:12345-0@lo:103: Request processed in 75us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141498:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744183.141529:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744183.141535:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3310:x1875634068419968:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141540:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141544:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 17 pid: 5829 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141582:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 17 pid: 5829 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141590:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.141614:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3310:x1875634068419968:12345-0@lo:103: Request processed in 80us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.141618:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788744183.141629:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744183.141635:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068419584:12345-0@lo:103: 00010000:00010000:1.0:1788744183.141641:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744183.141644:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 16 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141657:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 16 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141669:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141676:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.141690:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744183.141842:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419328:0@lo:103: 00000100:00100000:0.0:1788744183.141850:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419840:0@lo:103: 00000100:00100000:0.0:1788744183.141858:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419200:0@lo:103: 00000100:00100000:0.0:1788744183.141864:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068419712:0@lo:103: 00010000:00010000:3.0:1788744183.142157:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788744183.142167:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:8441:x1875634068418560:12345-0@lo:104: Request processed in 8998us (13490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744183.142175:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788744183.142237:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744183.142262:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142269:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142275:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142280:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744183.142284:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142293:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142302:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744183.142322:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744183.142352:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068419584:12345-0@lo:103: Request processed in 717us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744183.142357:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744183.142399:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419584:0@lo:103: 00000100:00100000:1.0:1788744183.142407:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419456:0@lo:103: 00000100:00100000:1.0:1788744183.142414:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068419968:0@lo:103: 00010000:00010000:0.0:1788744183.142630:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cba00/0x7cd2bfd5e1b94582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9457b expref: 15 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744183.142653:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff939880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418688:0@lo:104: 00010000:00010000:0.0:1788744183.142664:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9456d expref: 14 pid: 5828 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744183.142671:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418816:0@lo:104: 00010000:00010000:0.0:1788744183.142679:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b9454a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94543 expref: 13 pid: 5830 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744183.142688:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068418944:0@lo:104: 00010000:00010000:0.0:1788744183.142707:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cb000/0x7cd2bfd5e1b94520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94519 expref: 12 pid: 5829 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744183.142715:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875634068419072:0@lo:104: 00010000:00010000:0.0:1788744183.142747:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.142756:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.142773:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744183.142779:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7388600/0x7cd2bfd5e1b94623 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744183.147672:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744183.450895:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744184.475080:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788744184.730663:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788744184.730672:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940b004f2800 from 39 10000000:01000000:0.0:1788744184.730677:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788744184.730730:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.730741:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.730752:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.730777:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420096:0@lo:101: 00000100:00100000:0.0:1788744184.730869:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.730941:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.732827:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420096 00000100:00100000:2.0:1788744184.732841:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420096 00000100:00100000:2.0:1788744184.732907:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788744184.732917:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+12:5833:x1875634068420096:12345-0@lo:101: 00010000:00010000:2.0:1788744184.732932:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744184.732949:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b94631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9462a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.732976:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b94631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9462a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.733004:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b94631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9462a expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.733012:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389600, rc 0) 00000100:00100000:2.0:1788744184.733085:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420096:12345-0@lo:101: Request processed in 169us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.733091:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788744184.733904:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420096:0@lo:101: 00010000:00010000:0.0:1788744184.733925:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.733935:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.734023:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420224:0@lo:501: 00000100:00100000:0.0:1788744184.734060:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.734114:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.735597:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420224 00000100:00100000:2.0:1788744184.735607:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420224 00000100:00100000:2.0:1788744184.735659:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788744184.735668:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420224:12345-0@lo:501: 00000100:00100000:2.0:1788744184.736691:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420224:12345-0@lo:501: Request processed in 1020us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.736701:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788744184.749694:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420224:0@lo:501: 00000100:00100000:3.0:1788744184.749761:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420352:0@lo:503: 00000100:00100000:3.0:1788744184.749853:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.749907:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.750465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420352 00000100:00100000:1.0:1788744184.750475:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420352 00000100:00100000:1.0:1788744184.750542:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788744184.750573:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420352:12345-0@lo:503: 00000100:00100000:1.0:1788744184.750773:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420352:12345-0@lo:503: Request processed in 222us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.750780:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788744184.752712:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420352:0@lo:503: 00000100:00100000:3.0:1788744184.767135:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8458:1875634068420480:0@lo:502: 00000100:00100000:3.0:1788744184.767234:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.767286:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.767344:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420480 00000100:00100000:0.0:1788744184.767353:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420480 00000100:00100000:0.0:1788744184.767403:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788744184.767414:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:8458:x1875634068420480:12345-0@lo:502: 00000100:00100000:0.0:1788744184.767729:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:8458:x1875634068420480:12345-0@lo:502: Request processed in 315us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.767737:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788744184.767879:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8458:1875634068420480:0@lo:502: 00000100:00100000:3.0:1788744184.767943:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8458:1875634068420608:0@lo:502: 00000100:00100000:3.0:1788744184.767978:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.768046:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.770762:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420608 00000100:00100000:2.0:1788744184.770778:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420608 00000100:00100000:2.0:1788744184.770911:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788744184.771047:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:8458:x1875634068420608:12345-0@lo:502: 00000100:00100000:2.0:1788744184.772748:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:8458:x1875634068420608:12345-0@lo:502: Request processed in 1822us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.772760:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788744184.772993:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8458:1875634068420608:0@lo:502: 00000040:00080000:3.0:1788744184.773033:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788744184.773763:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788744184.773788:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744184.773866:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.773879:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744184.773890:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788744184.773892:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788744184.773895:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788744184.774013:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.774021:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.774030:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.774060:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420736:0@lo:101: 00000100:00100000:0.0:1788744184.774498:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.774637:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.774730:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420736 00000100:00100000:2.0:1788744184.774737:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420736 00000100:00100000:2.0:1788744184.774869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788744184.774879:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+13:5833:x1875634068420736:12345-0@lo:101: 00010000:00010000:2.0:1788744184.774892:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744184.774910:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7389e00/0x7cd2bfd5e1b9463f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94638 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.774994:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389e00/0x7cd2bfd5e1b9463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94638 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.775006:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7389e00/0x7cd2bfd5e1b9463f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94638 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.775014:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389e00, rc 0) 00000100:00100000:2.0:1788744184.775098:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068420736:12345-0@lo:101: Request processed in 221us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.775112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788744184.775541:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420736:0@lo:101: 00010000:00010000:0.0:1788744184.775679:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.775689:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744184.776015:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420864:0@lo:501: 00000100:00100000:1.0:1788744184.776052:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.776399:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.776440:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420864 00000100:00100000:2.0:1788744184.776446:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420864 00000100:00100000:2.0:1788744184.776528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788744184.776537:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068420864:12345-0@lo:501: 00000100:00100000:2.0:1788744184.776936:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068420864:12345-0@lo:501: Request processed in 399us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.776944:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788744184.777007:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420864:0@lo:501: 00000100:00100000:3.0:1788744184.777043:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420992:0@lo:503: 00000100:00100000:3.0:1788744184.777093:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.777766:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.778763:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068420992 00000100:00100000:1.0:1788744184.778773:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068420992 00000100:00100000:1.0:1788744184.782433:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788744184.782452:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068420992:12345-0@lo:503: 00000100:00100000:1.0:1788744184.782785:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068420992:12345-0@lo:503: Request processed in 340us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.782794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788744184.783083:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068420992:0@lo:503: 00000100:00100000:1.0:1788744184.783824:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8459:1875634068421120:0@lo:502: 00000100:00100000:1.0:1788744184.783889:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.783930:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.784471:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421120 00000100:00100000:0.0:1788744184.784480:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421120 00000100:00100000:0.0:1788744184.784538:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788744184.784567:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:8459:x1875634068421120:12345-0@lo:502: 00000100:00100000:0.0:1788744184.786294:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:8459:x1875634068421120:12345-0@lo:502: Request processed in 1733us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.786305:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788744184.786944:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8459:1875634068421120:0@lo:502: 00000020:01000000:1.0:1788744184.786980:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744184.786990:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744184.786993:0:8459:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744184.786998:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744184.787031:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8459:1875634068421248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.787080:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.787159:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.787201:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421248 00000100:00100000:0.0:1788744184.787208:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421248 00000100:00100000:0.0:1788744184.787299:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788744184.787309:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:8459:x1875634068421248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.787574:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:8459:x1875634068421248:12345-0@lo:502:llog_process_th.0 Request processed in 266us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.787581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788744184.787738:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8459:1875634068421248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744184.787768:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744184.787780:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744184.787782:0:8459:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744184.787786:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788744184.787871:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788744184.787891:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788744184.787902:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.787915:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744184.787935:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744184.787938:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940aceda7000 from 39 10000000:01000000:3.0:1788744184.787941:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744184.787965:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.787972:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.787981:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744184.788006:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.788035:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744184.789608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421376 00000100:00100000:2.0:1788744184.789619:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421376 00000100:00100000:3.0:1788744184.789635:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad19850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.789750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788744184.789762:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:5833:x1875634068421376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744184.789923:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744184.789942:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7297e00/0x7cd2bfd5e1b9464d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94646 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.789967:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7297e00/0x7cd2bfd5e1b9464d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94646 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.789978:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7297e00/0x7cd2bfd5e1b9464d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94646 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.789988:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297e00, rc 0) 00000100:00100000:0.0:1788744184.790051:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068421376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.790059:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788744184.790128:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744184.790144:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.790153:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744184.790300:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.790342:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.795086:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad19850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.800665:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421504 00000100:00100000:0.0:1788744184.800681:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421504 00000100:00100000:0.0:1788744184.800747:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788744184.800757:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068421504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.802481:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068421504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1720us (12133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.802493:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744184.807279:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.807364:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.807439:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.807889:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad19850c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.821862:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421632 00000100:00100000:1.0:1788744184.821879:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421632 00000100:00100000:0.0:1788744184.822529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788744184.822541:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068421632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.822946:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068421632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 407us (15506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.822955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788744184.823498:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068421632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.829480:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8460:1875634068421760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744184.829600:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.829647:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421760 00000100:00100000:3.0:1788744184.829651:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.829657:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421760 00000100:00100000:1.0:1788744184.829726:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788744184.829736:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:8460:x1875634068421760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.830062:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:8460:x1875634068421760:12345-0@lo:502:llog_process_th.0 Request processed in 327us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.830071:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788744184.830174:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8460:1875634068421760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744184.830221:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8460:1875634068421888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744184.830269:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.830288:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.830407:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068421888 00000100:00100000:0.0:1788744184.830417:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068421888 00000100:00100000:0.0:1788744184.830445:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788744184.830452:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:8460:x1875634068421888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.830637:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:8460:x1875634068421888:12345-0@lo:502:llog_process_th.0 Request processed in 185us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.830644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788744184.832730:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8460:1875634068421888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788744184.832774:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788744184.833423:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788744184.833444:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744184.833454:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.833467:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744184.833476:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788744184.833478:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788744184.833481:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744184.833530:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.833539:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.833572:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.833593:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.833647:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.833682:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2f9a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.833699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422016 00000100:00100000:1.0:1788744184.833707:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422016 00000100:00100000:1.0:1788744184.833800:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788744184.833817:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:5833:x1875634068422016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744184.833830:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744184.833842:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164fe00/0x7cd2bfd5e1b9465b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94654 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.833868:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164fe00/0x7cd2bfd5e1b9465b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94654 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.833880:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164fe00/0x7cd2bfd5e1b9465b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94654 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.833889:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164fe00, rc 0) 00000100:00100000:1.0:1788744184.833939:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.833958:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788744184.834027:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744184.834040:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.834048:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744184.834101:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.834125:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.838825:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422144 00000100:00100000:0.0:1788744184.838842:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422144 00000100:00100000:3.0:1788744184.838870:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.838898:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788744184.838908:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.839253:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.839261:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788744184.839996:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.840053:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.840113:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.840136:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.840667:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422272 00000100:00100000:0.0:1788744184.840673:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422272 00000100:00100000:0.0:1788744184.840702:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788744184.840710:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.840885:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.840892:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788744184.841403:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744184.842543:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8461:1875634068422400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.842622:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.842658:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.842702:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422400 00000100:00100000:0.0:1788744184.842708:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422400 00000100:00100000:0.0:1788744184.842743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788744184.842751:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:8461:x1875634068422400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.843042:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:8461:x1875634068422400:12345-0@lo:502:llog_process_th.0 Request processed in 290us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.843050:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788744184.843232:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8461:1875634068422400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744184.843254:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744184.843318:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744184.843321:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744184.843325:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744184.843345:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8461:1875634068422528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.843375:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.843403:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.843494:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422528 00000100:00100000:2.0:1788744184.843499:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422528 00000100:00100000:2.0:1788744184.843541:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788744184.843578:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:8461:x1875634068422528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744184.843698:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:8461:x1875634068422528:12345-0@lo:502:llog_process_th.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.843710:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788744184.844012:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8461:1875634068422528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744184.844042:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744184.844046:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744184.844047:0:8461:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744184.844051:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788744184.844503:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788744184.844542:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788744184.844582:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.844594:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744184.844613:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788744184.844616:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ac7f4d800 from 39 10000000:01000000:3.0:1788744184.844619:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744184.844647:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.844655:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.844665:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744184.844681:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.844718:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744184.844745:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985300 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.845238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422656 00000100:00100000:0.0:1788744184.845245:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422656 00000100:00100000:0.0:1788744184.845384:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788744184.845392:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068422656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744184.845404:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744184.845423:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7296400/0x7cd2bfd5e1b94669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94662 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.845445:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7296400/0x7cd2bfd5e1b94669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94662 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.845456:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7296400/0x7cd2bfd5e1b94669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94662 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.845463:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296400, rc 0) 00000100:00100000:0.0:1788744184.845508:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068422656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.845524:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744184.845741:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744184.845756:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.845765:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744184.846022:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744184.846050:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744184.846178:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.846254:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422784 00000100:00100000:0.0:1788744184.846259:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422784 00000100:00100000:0.0:1788744184.846321:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788744184.846329:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068422784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.846580:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068422784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.846587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788744184.846651:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744184.846678:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744184.846712:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.846917:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.846965:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068422912 00000100:00100000:2.0:1788744184.846970:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068422912 00000100:00100000:2.0:1788744184.846988:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788744184.846994:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068422912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744184.847133:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068422912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.847139:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788744184.847328:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068422912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744184.847480:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8462:1875634068423040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.847508:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.847667:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.847719:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423040 00000100:00100000:0.0:1788744184.847724:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423040 00000100:00100000:0.0:1788744184.847741:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744184.847747:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8462:x1875634068423040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.848006:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8462:x1875634068423040:12345-0@lo:502:llog_process_th.0 Request processed in 258us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.848013:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788744184.848129:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8462:1875634068423040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.848174:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8462:1875634068423168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744184.848202:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744184.848220:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744184.848423:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423168 00000100:00100000:0.0:1788744184.848432:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423168 00000100:00100000:0.0:1788744184.848449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788744184.848454:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8462:x1875634068423168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.848611:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8462:x1875634068423168:12345-0@lo:502:llog_process_th.0 Request processed in 155us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.848617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788744184.848749:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8462:1875634068423168:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788744184.848767:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788744184.848949:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788744184.848972:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788744184.848980:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.848991:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744184.848999:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788744184.849001:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788744184.849004:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744184.849025:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.849032:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.849040:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.849053:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.849087:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.849113:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.849278:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423296 00000100:00100000:1.0:1788744184.849282:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423296 00000100:00100000:1.0:1788744184.849299:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788744184.849304:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068423296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744184.849312:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744184.849323:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b94677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94670 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.849349:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b94677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94670 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.849359:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b94677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94670 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.849367:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164e200, rc 0) 00000100:00100000:1.0:1788744184.849402:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.849407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788744184.849466:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744184.849477:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744184.849485:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744184.849534:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.849579:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.849592:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.849646:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423424 00000100:00100000:1.0:1788744184.849650:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423424 00000100:00100000:1.0:1788744184.849665:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788744184.849669:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744184.849860:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.849867:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788744184.850022:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.850045:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.850141:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.850227:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.850289:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423552 00000100:00100000:2.0:1788744184.850294:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423552 00000100:00100000:2.0:1788744184.850315:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788744184.850321:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744184.850444:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.850451:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788744184.850580:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744184.850983:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8463:1875634068423680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.851286:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.851316:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.851440:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423680 00000100:00100000:2.0:1788744184.851445:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423680 00000100:00100000:2.0:1788744184.851476:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788744184.851482:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8463:x1875634068423680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744184.851677:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8463:x1875634068423680:12345-0@lo:502:llog_process_th.0 Request processed in 194us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744184.851684:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788744184.851862:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8463:1875634068423680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744184.851885:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744184.851892:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744184.851894:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744184.851900:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788744184.852064:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8463:1875634068423808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.852155:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744184.852449:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1c62b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744184.852533:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423808 00000100:00100000:2.0:1788744184.852538:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423808 00000100:00100000:0.0:1788744184.852782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788744184.852799:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8463:x1875634068423808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744184.852985:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8463:x1875634068423808:12345-0@lo:502:llog_process_th.0 Request processed in 195us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744184.852992:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744184.853060:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8463:1875634068423808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744184.853303:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744184.853309:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744184.853311:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788744184.853315:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788744184.853461:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788744184.853482:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788744184.853491:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744184.853503:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744184.853529:0:5833:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788744184.853532:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff940ad0d43380 from 1 10000000:01000000:3.0:1788744184.853536:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788744184.853740:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.853749:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.853759:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744184.853775:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744184.853820:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744184.854024:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744184.854049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068423936 00000100:00100000:1.0:1788744184.854055:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068423936 00000100:00100000:1.0:1788744184.854086:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788744184.854093:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068423936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744184.854103:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744184.854114:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9467e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.854135:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9467e expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.854166:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9467e expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744184.854176:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f600, rc 0) 00000100:00100000:1.0:1788744184.854213:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068423936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744184.854219:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788744184.854378:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068423936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744184.854390:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.854399:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744184.854449:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068424064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744184.854470:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744184.854489:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744184.854540:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424064 00000100:00100000:3.0:1788744184.854545:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424064 00000100:00100000:3.0:1788744184.854594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788744184.854599:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068424064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744184.854904:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068424064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (431us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744184.854911:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788744184.855029:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068424064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788744184.855050:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788744184.855057:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744184.855074:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744185.499727:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744186.099077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744186.099230:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423232 00000100:00100000:3.0:1788744186.099242:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423232 00000100:00100000:2.0:1788744186.101848:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00100000:2.0:1788744186.101876:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+8:5595:x1875634047423232:12345-192.168.204.56@tcp:101: 00010000:00010000:2.0:1788744186.101896:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744186.101915:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9468c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610b0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744186.101945:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744186.101955:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9468c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744186.101965:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388000, rc 0) 00000100:00100000:2.0:1788744186.102041:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423232:12345-192.168.204.56@tcp:101: Request processed in 177us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744186.102048:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00100000:2.0:1788744186.111615:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744186.111928:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423360 00000100:00100000:0.0:1788744186.111939:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423360 00000100:00100000:0.0:1788744186.112007:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 168 00000100:00100000:0.0:1788744186.112018:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423360:12345-192.168.204.56@tcp:501: 00000100:00100000:0.0:1788744186.112343:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423360:12345-192.168.204.56@tcp:501: Request processed in 325us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.112351:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 168 00000100:00100000:0.0:1788744186.118296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744186.118437:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423488 00000100:00100000:2.0:1788744186.118447:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423488 00000100:00100000:2.0:1788744186.118513:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 169 00000100:00100000:2.0:1788744186.118539:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423488:12345-192.168.204.56@tcp:503: 00000100:00100000:2.0:1788744186.119514:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423488:12345-192.168.204.56@tcp:503: Request processed in 973us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744186.119523:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 169 00000100:00100000:2.0:1788744186.137683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744186.137802:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423616 00000100:00100000:1.0:1788744186.137813:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423616 00000100:00100000:1.0:1788744186.137870:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 170 00000100:00100000:1.0:1788744186.137881:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:6073:x1875634047423616:12345-192.168.204.56@tcp:502: 00000100:00100000:1.0:1788744186.138144:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:6073:x1875634047423616:12345-192.168.204.56@tcp:502: Request processed in 264us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744186.138152:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 170 00000100:00100000:3.0:1788744186.155438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744186.159396:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423744 00000100:00100000:0.0:1788744186.159415:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423744 00000100:00100000:0.0:1788744186.159503:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 171 00000100:00100000:0.0:1788744186.159515:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:6073:x1875634047423744:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744186.159983:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:6073:x1875634047423744:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 469us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.159993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 171 00000100:00100000:0.0:1788744186.182958:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744186.187047:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047423872 00000100:00100000:3.0:1788744186.187067:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047423872 00000100:00100000:3.0:1788744186.187161:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 172 00000100:00100000:3.0:1788744186.187172:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047423872:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744186.187191:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744186.187210:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc000/0x7cd2bfd5e1b94693 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610b7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744186.187241:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc000/0x7cd2bfd5e1b94693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b7 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744186.187265:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc000/0x7cd2bfd5e1b94693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b7 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744186.187293:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc000, rc 0) 00000100:00100000:2.0:1788744186.201072:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047423872:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 13890us (18113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744186.201103:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 172 00000100:00100000:2.0:1788744186.205108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744186.205261:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424000 00000100:00100000:1.0:1788744186.205272:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424000 00000100:00100000:1.0:1788744186.205384:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 173 00000100:00100000:1.0:1788744186.205395:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047424000:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744186.205729:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047424000:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 334us (640us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744186.205738:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 173 00000100:00100000:3.0:1788744186.344417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744186.344463:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744186.344510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744186.344588:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744186.344743:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424384 00000100:00100000:0.0:1788744186.344755:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424384 00000100:00100000:0.0:1788744186.344837:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424512 00000100:00100000:0.0:1788744186.344841:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424512 00000100:00100000:0.0:1788744186.344859:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:0.0:1788744186.344869:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047424384:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744186.344942:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047424384:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 74us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.344950:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:0.0:1788744186.344968:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744186.344974:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047424512:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744186.344998:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047424512:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.345003:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:1.0:1788744186.345388:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424256 00000100:00100000:1.0:1788744186.345393:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424256 00000100:00100000:1.0:1788744186.345436:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:1.0:1788744186.345445:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047424256:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744186.345500:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047424256:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 56us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744186.345507:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00080000:3.0:1788744186.345969:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744186.345975:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744186.345977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744186.347199:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424128 00000100:00100000:2.0:1788744186.347210:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424128 00000100:00100000:2.0:1788744186.347269:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 174 00000100:00100000:2.0:1788744186.347278:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047424128:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744186.347353:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047424128:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 76us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744186.347360:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 174 00010000:00010000:2.0:1788744186.525107:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744186.909634:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068424320:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.909706:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.909763:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068424832:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.909789:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.909824:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744186.909831:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068424448:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.909855:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.909874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068424960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744186.909896:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.909924:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424832 00000100:00100000:0.0:1788744186.909932:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424832 00000100:00100000:0.0:1788744186.909990:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744186.909999:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.910064:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068424832:12345-0@lo:400:kworker.0 Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.910072:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788744186.910094:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424320 00000100:00100000:0.0:1788744186.910097:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424320 00000100:00100000:0.0:1788744186.910123:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424448 00000100:00100000:0.0:1788744186.910125:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424448 00000100:00100000:0.0:1788744186.910142:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744186.910147:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068424320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.910177:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068424320:12345-0@lo:400:kworker.0 Request processed in 29us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.910182:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744186.910193:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744186.910198:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068424448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.910223:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068424448:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.910228:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744186.910370:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424960 00000100:00100000:0.0:1788744186.910375:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424960 00000100:00100000:0.0:1788744186.910399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788744186.910406:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068424960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744186.910434:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744186.910465:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068424960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.910471:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788744186.910497:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744186.910501:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744186.910544:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068424448:0@lo:400:kworker.0 00010000:00080000:0.0:1788744186.910585:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad817aa00 x1875634068424960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744186.911818:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068424960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744186.911846:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068424320:0@lo:400:kworker.0 00010000:00080000:0.0:1788744186.911859:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4ced80 x1875634068424832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744186.911868:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068424832:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.911935:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068424576:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.911979:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.912014:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744186.912022:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068424192:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.912047:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.912077:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068424704:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.912100:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744186.912130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424704 00000100:00100000:0.0:1788744186.912136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424704 00000100:00100000:0.0:1788744186.912174:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744186.912182:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.912242:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068424704:12345-0@lo:400:kworker.0 Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.912250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788744186.912272:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744186.912290:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068424704:0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.912346:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424192 00000100:00100000:0.0:1788744186.912350:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424192 00000100:00100000:0.0:1788744186.912375:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788744186.912382:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744186.912419:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068424192:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744186.912424:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788744186.912455:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068424192:0@lo:400:kworker.0 00000100:00100000:3.0:1788744186.913097:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068424576 00000100:00100000:3.0:1788744186.913105:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068424576 00000100:00100000:3.0:1788744186.913154:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744186.913162:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068424576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744186.913213:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068424576:12345-0@lo:400:kworker.0 Request processed in 52us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744186.913219:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788744186.913278:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cd880 x1875634068424576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744186.913289:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068424576:0@lo:400:kworker.0 00000100:00080000:1.0:1788744186.913591:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788744187.546862:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788744187.678224:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe69e83300 20000000:00000080:1.0:1788744187.678244:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940af772ac00 uarg=0000000000000000 20000000:01000000:1.0:1788744187.678283:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744187.678290:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744187.678294:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788744187.688782:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788744187.690063:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788744187.702287:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788744187.702372:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788744187.702436:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788744187.702453:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788744187.702484:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702503:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702511:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702517:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702528:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702577:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702623:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702640:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 9 pid: 5829 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.702657:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425088:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744187.702791:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.702800:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 18 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.702809:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425216:0@lo:104: 00000100:00100000:0.0:1788744187.702851:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744187.705495:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.705514:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 18 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.705529:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425344:0@lo:104: 00000100:00100000:0.0:1788744187.705607:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744187.705700:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.705733:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 18 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.705743:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425472:0@lo:104: 00000100:00100000:0.0:1788744187.705765:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7fbc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744187.710401:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425088:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744187.712089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744187.713334:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424640 00000100:00100000:0.0:1788744187.713346:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424640 00010000:00010000:0.0:1788744187.713389:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.713438:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:0.0:1788744187.713448:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047424640:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744187.713478:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744187.713484:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.713497:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.713514:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7388e00/0x7cd2bfd5e1b945f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576107f expref: 10 pid: 5829 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.713531:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744187.713609:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:2354:x1875634047424640:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 162us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744187.713616:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744187.718103:0:8446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788744187.718169:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744187.718217:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425216 00000100:00100000:2.0:1788744187.718226:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425216 00000100:00100000:2.0:1788744187.718270:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425344 00000100:00100000:2.0:1788744187.718274:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425344 00000100:00100000:2.0:1788744187.718285:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425472 00000100:00100000:2.0:1788744187.718287:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425472 00000100:00100000:2.0:1788744187.718301:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744187.718313:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:8502:x1875634068425216:12345-0@lo:104: 00010000:00010000:2.0:1788744187.718352:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718434:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744187.718441:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:8502:x1875634068425216:12345-0@lo:104: Request processed in 130us (15589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744187.718448:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788744187.718475:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744187.718482:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa86f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:8502:x1875634068425344:12345-0@lo:104: 00010000:00010000:2.0:1788744187.718490:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718525:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788744187.718530:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa86f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:8502:x1875634068425344:12345-0@lo:104: Request processed in 51us (12925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744187.718535:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788744187.718581:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788744187.718588:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:8502:x1875634068425472:12345-0@lo:104: 00010000:00010000:2.0:1788744187.718595:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718622:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788744187.718627:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:8502:x1875634068425472:12345-0@lo:104: Request processed in 40us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744187.718632:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788744187.718658:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744187.718664:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718678:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744187.718682:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718690:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744187.718698:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744187.718704:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744187.718752:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718759:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744187.718796:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718804:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b94535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9453c expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718822:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744187.718826:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718832:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744187.718835:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718853:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744187.718871:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744187.718877:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744187.718970:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718976:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744187.718983:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718989:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac29ca600/0x7cd2bfd5e1b944da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b944e1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.718999:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744187.719002:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719009:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744187.719012:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719019:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744187.719026:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744187.719037:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744187.719048:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719054:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744187.719070:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719077:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164f000/0x7cd2bfd5e1b9445c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94463 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719089:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744187.719091:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744187.719093:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744187.719099:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744187.719121:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068425728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744187.719158:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744187.719200:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744187.719206:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068425600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744187.719227:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744187.719256:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068425856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744187.719278:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744187.719309:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425728 00000100:00100000:2.0:1788744187.719314:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425728 00010000:00010000:2.0:1788744187.719336:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 19 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744187.719365:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425600 00000100:00100000:2.0:1788744187.719374:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425600 00010000:00010000:2.0:1788744187.719387:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 20 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744187.719399:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425856 00000100:00100000:2.0:1788744187.719401:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425856 00010000:00010000:2.0:1788744187.719410:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 21 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744187.719420:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744187.719426:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+21:3311:x1875634068425728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744187.719437:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744187.719442:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 21 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719450:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 21 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719477:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744187.719505:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+21:3311:x1875634068425728:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744187.719511:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744187.719524:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744187.719533:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3311:x1875634068425600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744187.719541:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744187.719546:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 20 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744187.719576:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 20 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744187.719585:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744187.719691:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cbc00/0x7cd2bfd5e1b9453c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94535 expref: 20 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.719702:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425216:0@lo:104: 00000100:00100000:2.0:1788744187.719745:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744187.719755:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068425856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744187.719764:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744187.719768:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 19 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719777:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 19 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719799:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719807:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719821:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719829:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719835:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719842:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719847:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744187.719851:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719858:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719866:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744187.719875:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744187.727961:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068425600:12345-0@lo:103:ldlm_bl.0 Request processed in 8419us (8722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744187.727976:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788744187.728850:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cb800/0x7cd2bfd5e1b944e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b944da expref: 18 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.729004:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425344:0@lo:104: 00010000:00010000:0.0:1788744187.729027:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b94463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9445c expref: 17 pid: 5829 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.729039:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1875634068425472:0@lo:104: 00010000:00010000:0.0:1788744187.729075:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.729086:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.729093:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744187.729099:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b9469a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744187.736443:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068425600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744187.736471:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068425728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744187.742730:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3312:x1875634068425856:12345-0@lo:103:ldlm_bl.0 Request processed in 22966us (23439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744187.742765:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744187.743034:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068425856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744187.918666:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744187.918812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424768 00000100:00100000:1.0:1788744187.918823:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424768 00000100:00100000:1.0:1788744187.918886:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 176 00000100:00100000:1.0:1788744187.918897:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:5595:x1875634047424768:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744187.918914:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744187.918945:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610be expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744187.918978:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744187.918990:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744187.918999:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f000, rc 0) 00000100:00100000:1.0:1788744187.919056:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047424768:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 161us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744187.919062:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 176 00000100:00100000:3.0:1788744187.929021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744187.929126:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047424896 00000100:00100000:1.0:1788744187.929137:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047424896 00000100:00100000:1.0:1788744187.929196:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 177 00000100:00100000:1.0:1788744187.929207:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047424896:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744187.929534:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047424896:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 328us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744187.929543:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 177 00000100:00100000:3.0:1788744187.935035:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068425984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744187.935127:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744187.935211:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068425984 00000100:00100000:3.0:1788744187.935218:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068425984 00000100:00100000:3.0:1788744187.935268:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744187.935276:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068425984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744187.935327:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744187.935375:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068425984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744187.935382:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788744187.935427:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cc000 x1875634068425984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744187.935446:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068425984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744187.937515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744187.937645:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425024 00000100:00100000:0.0:1788744187.937661:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425024 00000100:00100000:0.0:1788744187.937711:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 178 00000100:00100000:0.0:1788744187.937720:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047425024:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744187.937929:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:5595:x1875634047425024:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 209us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744187.937937:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 178 00000100:00100000:1.0:1788744187.961285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744187.961671:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425152 00000100:00100000:3.0:1788744187.961682:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425152 00000100:00100000:3.0:1788744187.961736:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:3.0:1788744187.961747:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:6108:x1875634047425152:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744187.976862:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:6108:x1875634047425152:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 15107us (15576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744187.976878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:3.0:1788744187.989541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744187.989644:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425280 00000100:00100000:3.0:1788744187.989657:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425280 00000100:00100000:3.0:1788744187.989719:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 180 00000100:00100000:3.0:1788744187.989729:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:6108:x1875634047425280:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744187.989986:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:6108:x1875634047425280:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 258us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744187.989995:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 180 00010000:00010000:2.0:1788744188.573362:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744188.891689:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744188.891697:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940b004f2800 from 4 10000000:01000000:2.0:1788744188.891701:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744188.891756:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744188.891769:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744188.891787:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744188.891816:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744188.891896:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744188.892053:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.892220:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426112 00000100:00100000:3.0:1788744188.892229:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426112 00000100:00100000:3.0:1788744188.892322:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788744188.892345:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068426112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744188.892358:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744188.892369:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b946a8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.892393:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.892403:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.892412:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744188.892467:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.892474:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788744188.892541:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744188.892571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744188.892580:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744188.892636:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744188.892660:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744188.892870:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.893176:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426240 00000100:00100000:1.0:1788744188.893182:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426240 00000100:00100000:1.0:1788744188.893207:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788744188.893213:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.893489:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.893502:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788744188.893619:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744188.893652:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744188.893689:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744188.893701:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.893778:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426368 00000100:00100000:1.0:1788744188.893782:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426368 00000100:00100000:1.0:1788744188.893799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788744188.893805:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.893940:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.893947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788744188.894153:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744188.894789:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8533:1875634068426496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744188.894831:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744188.894864:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.894962:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426496 00000100:00100000:1.0:1788744188.894967:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426496 00000100:00100000:1.0:1788744188.894997:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788744188.895004:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8533:x1875634068426496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.895143:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8533:x1875634068426496:12345-0@lo:502:llog_process_th.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.895149:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788744188.895336:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8533:1875634068426496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744188.895356:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744188.895365:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744188.895367:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744188.895374:0:8533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940b004f2800 00000020:00000080:2.0:1788744188.895376:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788744188.895460:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8533:1875634068426624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744188.895492:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744188.895504:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c1141e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.897145:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426624 00000100:00100000:3.0:1788744188.897156:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426624 00000100:00100000:3.0:1788744188.897203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788744188.897211:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8533:x1875634068426624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744188.897525:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:8533:x1875634068426624:12345-0@lo:502:llog_process_th.0 Request processed in 314us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.897534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788744188.900403:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8533:1875634068426624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788744188.900460:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744188.900469:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744188.900471:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788744188.900475:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744188.901852:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744188.901877:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744188.901889:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.901903:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744188.901914:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744188.901917:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940aceda7000 from 4 10000000:01000000:1.0:1788744188.901919:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744188.901955:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.901969:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.901980:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744188.902011:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.902090:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.902136:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.904275:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426752 00000100:00100000:3.0:1788744188.904288:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426752 00000100:00100000:3.0:1788744188.904344:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788744188.904354:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068426752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744188.904369:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744188.904393:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b946b6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.904420:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.904431:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.904450:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc200, rc 0) 00000100:00100000:3.0:1788744188.904529:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068426752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.904536:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788744188.904646:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744188.904664:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.904673:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744188.904738:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.904771:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.904800:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.904815:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068426880 00000100:00100000:1.0:1788744188.904819:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068426880 00000100:00100000:1.0:1788744188.904842:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788744188.904849:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068426880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.905219:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068426880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.905226:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788744188.905264:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068426880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.905292:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.905329:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.905343:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.905353:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427008 00000100:00100000:1.0:1788744188.905357:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427008 00000100:00100000:1.0:1788744188.905376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788744188.905382:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068427008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.905525:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068427008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.905531:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788744188.905587:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.905777:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8536:1875634068427136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.905808:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.905826:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427136 00000100:00100000:1.0:1788744188.905829:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427136 00000100:00100000:1.0:1788744188.905849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788744188.905854:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8536:x1875634068427136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.905969:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8536:x1875634068427136:12345-0@lo:502:llog_process_th.0 Request processed in 114us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.905975:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788744188.906610:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac361ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.906628:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8536:1875634068427136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744188.906652:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744188.906662:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744188.906664:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788744188.906676:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940aceda7000 00000020:00000080:3.0:1788744188.906679:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744188.906765:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8536:1875634068427264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744188.906807:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744188.906832:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427264 00000100:00100000:3.0:1788744188.906837:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427264 00000100:00100000:3.0:1788744188.906863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788744188.906870:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8536:x1875634068427264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744188.907094:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:8536:x1875634068427264:12345-0@lo:502:llog_process_th.0 Request processed in 151us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.907110:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788744188.907145:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1985240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.907156:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8536:1875634068427264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744188.907175:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744188.907179:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744188.907181:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788744188.907185:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788744188.907618:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788744188.907634:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744188.907644:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744188.907655:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744188.907665:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744188.907668:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac7f4d800 from 4 10000000:01000000:0.0:1788744188.907671:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744188.907694:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744188.907702:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744188.907710:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744188.907725:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744188.907754:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744188.907781:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.908635:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427392 00000100:00100000:3.0:1788744188.908644:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427392 00000100:00100000:3.0:1788744188.908681:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788744188.908688:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068427392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744188.908700:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744188.908715:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b946c4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.908743:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.908754:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744188.908763:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc800, rc 0) 00000100:00100000:3.0:1788744188.908813:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068427392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.908820:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788744188.910272:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744188.910295:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.910318:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744188.910410:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.910480:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.910530:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad804dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744188.910612:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427520 00000100:00100000:3.0:1788744188.910618:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427520 00000100:00100000:3.0:1788744188.910653:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788744188.910666:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068427520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744188.910912:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068427520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744188.910919:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788744188.914008:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.914083:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.914158:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.914191:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad804dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.914217:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427648 00000100:00100000:1.0:1788744188.914224:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427648 00000100:00100000:1.0:1788744188.914272:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788744188.914281:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068427648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.914488:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068427648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.914497:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788744188.914544:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068427648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744188.914797:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8537:1875634068427776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.914832:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.914850:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427776 00000100:00100000:1.0:1788744188.914855:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427776 00000100:00100000:1.0:1788744188.914875:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788744188.914882:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:8537:x1875634068427776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.915006:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:8537:x1875634068427776:12345-0@lo:502:llog_process_th.0 Request processed in 124us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.915013:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788744188.915041:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3085540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.915054:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8537:1875634068427776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744188.915074:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744188.915085:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744188.915088:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788744188.915095:0:8537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ac7f4d800 00000020:00000080:1.0:1788744188.915098:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788744188.915582:0:8537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8537:1875634068427904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.915620:0:8537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744188.915642:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068427904 00000100:00100000:1.0:1788744188.915646:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068427904 00000100:00100000:1.0:1788744188.915668:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788744188.915674:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:8537:x1875634068427904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744188.915792:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:8537:x1875634068427904:12345-0@lo:502:llog_process_th.0 Request processed in 117us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744188.915798:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788744188.915827:0:8537:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3085540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744188.915841:0:8537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:8537:1875634068427904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744188.915858:0:8537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744188.915862:0:8537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744188.915864:0:8537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788744188.915867:0:8537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788744188.915917:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788744188.915943:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744188.915952:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744188.915962:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744189.610649:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744190.618872:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744191.465599:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744191.465634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744191.465657:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744191.465685:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744191.465726:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425664 00000100:00100000:1.0:1788744191.465736:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425664 00000100:00100000:0.0:1788744191.465804:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425792 00000100:00100000:0.0:1788744191.465812:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425792 00000100:00100000:1.0:1788744191.465813:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744191.465827:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047425664:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744191.465843:0:6681:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788744191.465852:0:6681:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788744191.465902:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047425664:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744191.465909:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744191.465924:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:1.0:1788744191.465934:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047425792:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744191.465956:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047425792:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744191.465961:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:1.0:1788744191.465979:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425536 00000100:00100000:1.0:1788744191.465982:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425536 00000100:00100000:1.0:1788744191.466007:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00080000:2.0:1788744191.466021:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744191.466027:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047425536:12345-192.168.204.56@tcp:400:kworker.0 00000100:00080000:2.0:1788744191.466029:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744191.466032:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744191.466067:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047425536:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 55us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744191.466073:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:3.0:1788744191.466316:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425408 00000100:00100000:3.0:1788744191.466321:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425408 00000100:00100000:3.0:1788744191.466348:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 196 00000100:00100000:3.0:1788744191.466356:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047425408:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744191.466380:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047425408:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744191.466396:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 196 00010000:00010000:0.0:1788744191.644139:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744192.026779:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744192.026818:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068428032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744192.026890:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744192.027161:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068428416:0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.027197:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744192.027227:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744192.027235:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068428288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.027259:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744192.027292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428416 00000100:00100000:1.0:1788744192.027301:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428416 00000100:00100000:1.0:1788744192.027359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428288 00000100:00100000:1.0:1788744192.027362:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428288 00000100:00100000:1.0:1788744192.027412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744192.027423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068428416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744192.027438:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068428544:0@lo:400:kworker.0 00000100:00100000:3.0:1788744192.027489:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744192.027498:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068428416:12345-0@lo:400:kworker.0 Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744192.027506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788744192.027526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788744192.027532:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068428288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744192.027624:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788744192.027630:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068428160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.027845:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068428288:12345-0@lo:400:kworker.0 Request processed in 312us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744192.027852:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1788744192.027872:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744192.027890:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428544 00000100:00100000:1.0:1788744192.027894:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428544 00000100:00100000:1.0:1788744192.027939:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744192.027946:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068428544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.027992:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068428544:12345-0@lo:400:kworker.0 Request processed in 46us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744192.027998:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744192.028039:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068428288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.028052:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068428416:0@lo:400:kworker.0 00000100:00080000:2.0:1788744192.028063:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744192.028575:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428032 00000100:00100000:0.0:1788744192.028582:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428032 00000100:00100000:0.0:1788744192.028631:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788744192.028641:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068428032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744192.028676:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744192.028731:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068428032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744192.028738:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788744192.028783:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c48700 x1875634068428032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744192.028802:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068428032:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788744192.029629:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744192.029637:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744192.029945:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428160 00000100:00100000:0.0:1788744192.029953:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428160 00000100:00100000:0.0:1788744192.030002:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788744192.030012:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068428160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744192.030058:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068428160:12345-0@lo:400:kworker.0 Request processed in 48us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744192.030064:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788744192.030155:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068428672:0@lo:400:kworker.0 00000100:00100000:3.0:1788744192.030191:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788744192.030231:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9409c3767800 x1875634068428544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744192.030243:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068428544:0@lo:400:kworker.0 00000100:00100000:3.0:1788744192.030261:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068428160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.030411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428672 00000100:00100000:1.0:1788744192.030416:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428672 00000100:00080000:2.0:1788744192.030468:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744192.030471:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788744192.030481:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068428672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744192.030529:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068428672:12345-0@lo:400:kworker.0 Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744192.030536:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744192.030625:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068428672:0@lo:400:kworker.0 00010000:00010000:0.0:1788744192.671657:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744193.058646:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744193.058671:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068428800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744193.058763:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744193.058838:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428800 00000100:00100000:0.0:1788744193.058846:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428800 00000100:00100000:0.0:1788744193.058906:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788744193.058913:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068428800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744193.058948:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744193.058993:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068428800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744193.059001:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788744193.059040:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c4a680 x1875634068428800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744193.059059:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068428800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744193.690814:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744194.714672:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744195.106900:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788744195.740375:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744196.587322:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744196.587392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744196.588836:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426048 00000100:00100000:0.0:1788744196.588851:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426048 00000100:00100000:0.0:1788744196.588949:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:0.0:1788744196.588961:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047426048:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744196.589044:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047426048:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 85us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744196.589051:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:1.0:1788744196.589326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047425920 00000100:00100000:1.0:1788744196.589331:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047425920 00000100:00100000:1.0:1788744196.589371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 198 00000100:00100000:1.0:1788744196.589380:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047425920:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744196.589417:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047425920:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 40us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744196.589424:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 198 00000100:00080000:2.0:1788744196.589732:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744196.590260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744196.594056:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426176 00000100:00100000:1.0:1788744196.594073:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426176 00000100:00100000:1.0:1788744196.594172:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:1.0:1788744196.594183:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2350:x1875634047426176:12345-192.168.204.56@tcp:9:kworker.0 00000020:00000080:1.0:1788744196.594246:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94607 00000100:00080000:1.0:1788744196.594259:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940b004f3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744196.594318:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744196.594735:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+2:2350:x1875634047426176:12345-192.168.204.56@tcp:9:kworker.0 Request processed in 552us (4474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744196.594743:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00010000:00010000:0.0:1788744196.597246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744196.597415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744196.597613:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426304 00000100:00100000:1.0:1788744196.597624:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426304 00000100:00100000:1.0:1788744196.597677:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:1.0:1788744196.597694:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2350:x1875634047426304:12345-192.168.204.56@tcp:9:kworker.0 00000020:00000080:1.0:1788744196.597731:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9460e 00000100:00080000:1.0:1788744196.597741:0:6682:0:(import.c:65:import_set_state_nolock()) ffff940b004f3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744196.597779:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744196.598122:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+2:2350:x1875634047426304:12345-192.168.204.56@tcp:9:kworker.0 Request processed in 435us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744196.598132:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00010000:00010000:1.0:1788744196.598155:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744196.598248:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744196.598253:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788744196.762734:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744197.147501:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744197.147537:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744197.147676:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744197.147834:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068428928 00000100:00100000:3.0:1788744197.147846:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068428928 00000100:00100000:3.0:1788744197.147917:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744197.147929:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068428928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744197.147975:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744197.148097:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068429056:0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.148141:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744197.148172:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744197.148178:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068429184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.148206:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744197.148238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429056 00000100:00100000:2.0:1788744197.148244:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429056 00000100:00100000:2.0:1788744197.148286:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788744197.148294:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068429056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.148330:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068429056:12345-0@lo:400:kworker.0 Request processed in 37us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744197.148338:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788744197.148374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429184 00000100:00100000:2.0:1788744197.148378:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429184 00000100:00100000:2.0:1788744197.148410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744197.148416:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068429184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.148446:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068429184:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744197.148458:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744197.148504:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068429184:0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.148513:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068429056:0@lo:400:kworker.0 00000100:00100000:3.0:1788744197.148865:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068428928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 937us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744197.148874:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788744197.150321:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744197.151167:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744197.151198:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788744197.151514:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068429440:0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.151605:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068429312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744197.151621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744197.151692:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429568 00000100:00100000:1.0:1788744197.151703:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429568 00000100:00100000:1.0:1788744197.151782:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744197.151806:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068429568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744197.152068:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744197.152120:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429440 00000100:00100000:3.0:1788744197.152124:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429440 00000100:00100000:3.0:1788744197.152161:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788744197.152169:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068429440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.152271:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744197.152294:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744197.152303:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788744197.152371:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c48e00 x1875634068428928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744197.152403:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744197.152459:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429312 00000100:00100000:2.0:1788744197.152465:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429312 00000100:00100000:3.0:1788744197.152484:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068429440:12345-0@lo:400:kworker.0 Request processed in 312us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744197.152505:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788744197.152582:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaf100 x1875634068429440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744197.152601:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068429440:0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.152630:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744197.152642:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068429312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744197.152705:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068429312:12345-0@lo:400:kworker.0 Request processed in 66us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744197.152712:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744197.152763:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068429312:0@lo:400:kworker.0 00000100:00080000:0.0:1788744197.152892:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744197.153048:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068429568:12345-0@lo:400:kworker.0 Request processed in 1245us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744197.153066:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744197.153254:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068429568:0@lo:400:kworker.0 00010000:00010000:1.0:1788744197.787653:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744198.170864:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068429696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744198.170934:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744198.171715:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429696 00000100:00100000:2.0:1788744198.171725:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429696 00000100:00100000:2.0:1788744198.171780:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744198.171790:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068429696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744198.171831:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744198.176509:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068429696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4709us (5562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744198.176534:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788744198.177675:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaf800 x1875634068429696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744198.177904:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068429696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744198.811265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744199.834887:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744200.450341:0:9045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing yml_node 00000001:00100000:0.0:1788744200.811790:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:0.0:1788744200.811800:0:6708:0:(genops.c:885:class_export_put()) final put ffff940b004f7000/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:0.0:1788744200.811827:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff940b004f7000/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-OST0000 00000020:00000080:0.0:1788744200.811881:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940b004f3800 for lustre-OST0000 00010000:00010000:0.0:1788744200.861907:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744201.354871:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:1.0:1788744201.354880:0:7639:0:(genops.c:885:class_export_put()) final put ffff940b004f5800/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:1.0:1788744201.354904:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940b004f5800/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-OST0001 00000020:00000080:1.0:1788744201.354945:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940b004f3000 for lustre-OST0001 00000100:00100000:0.0:1788744201.724595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744201.724663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744201.724692:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426560 00000100:00100000:0.0:1788744201.724702:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426560 00000100:00100000:0.0:1788744201.724768:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:2.0:1788744201.724810:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426432 00000100:00100000:2.0:1788744201.724814:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426432 00000100:00100000:2.0:1788744201.724843:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 200 00000100:00100000:2.0:1788744201.724849:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047426432:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744201.724910:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047426432:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 62us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744201.724918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 200 00000100:00100000:0.0:1788744201.726588:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047426560:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744201.726753:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047426560:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 1975us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744201.726762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00080000:0.0:1788744201.726789:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744201.892508:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744202.267041:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068430080:0@lo:400:kworker.0 00000100:00100000:0.0:1788744202.267107:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744202.267191:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744202.267198:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430208:0@lo:400:kworker.0 00000100:00100000:0.0:1788744202.267223:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744202.267294:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430080 00000100:00100000:1.0:1788744202.267302:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430080 00000100:00100000:2.0:1788744202.267345:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068429824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267354:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788744202.267362:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068430080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744202.267378:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744202.267400:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068430336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267414:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068430080:12345-0@lo:400:kworker.0 Request processed in 53us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744202.267418:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744202.267433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744202.267438:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068429952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788744202.267452:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430336 00000100:00100000:1.0:1788744202.267455:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430336 00000100:00100000:2.0:1788744202.267457:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744202.267468:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429952 00000100:00100000:2.0:1788744202.267469:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267470:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429952 00000100:00100000:1.0:1788744202.267481:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744202.267486:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744202.267486:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068430336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267513:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068430336:12345-0@lo:400:kworker.0 Request processed in 27us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744202.267518:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788744202.267528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744202.267529:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3767800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068430336:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267544:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068429952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744202.267567:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068429824 00000100:00100000:2.0:1788744202.267570:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068429824 00000100:00100000:1.0:1788744202.267591:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068429952:12345-0@lo:400:kworker.0 Request processed in 58us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744202.267594:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788744202.267600:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068429824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788744202.267626:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430208 00000100:00100000:2.0:1788744202.267627:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068429824:12345-0@lo:400:kworker.0 Request processed in 27us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744202.267640:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430208 00000100:00100000:2.0:1788744202.267642:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788744202.267663:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430464 00000100:00100000:1.0:1788744202.267665:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430464 00000100:00100000:1.0:1788744202.267682:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744202.267688:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788744202.267791:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744202.267795:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744202.267797:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744202.267853:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068429952:0@lo:400:kworker.0 00000100:00100000:0.0:1788744202.267869:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068429824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.267945:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430208:12345-0@lo:400:kworker.0 Request processed in 258us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744202.273706:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744202.273734:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068430464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744202.273843:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068430464:12345-0@lo:400:kworker.0 Request processed in 124us (6354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744202.273850:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744202.274093:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744202.274136:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788744202.274706:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9409c3765f80 x1875634068430208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744202.274720:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430208:0@lo:400:kworker.0 00000100:00100000:2.0:1788744202.274734:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068430080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744202.274767:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430592 00000100:00100000:2.0:1788744202.274774:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430592 00000100:00100000:2.0:1788744202.274811:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744202.274818:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744202.274848:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744202.274891:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744202.274897:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788744202.274925:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeace00 x1875634068430592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744202.274940:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430592:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788744202.280493:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad050aa00 x1875634068430464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744202.280514:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad050aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788744202.287302:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788744202.906722:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744203.293501:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744203.293524:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744203.293605:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744203.293674:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430720 00000100:00100000:0.0:1788744203.293682:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430720 00000100:00100000:0.0:1788744203.293745:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744203.293755:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744203.293790:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744203.293832:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068430720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744203.293840:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788744203.293880:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceead180 x1875634068430720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744203.293899:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068430720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744203.931412:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744204.954750:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744205.986493:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744206.825840:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744206.825896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744206.826024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426816 00000100:00100000:1.0:1788744206.826038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426816 00000100:00100000:1.0:1788744206.826137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:1.0:1788744206.826149:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047426816:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744206.826284:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047426816:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 138us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744206.826293:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00080000:1.0:1788744206.826321:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744206.829540:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426688 00000100:00100000:2.0:1788744206.830027:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426688 00000100:00100000:2.0:1788744206.830136:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 202 00000100:00100000:2.0:1788744206.830154:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047426688:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744206.837778:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047426688:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 7613us (11933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744206.837798:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 202 00010000:00010000:0.0:1788744207.015458:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744207.386976:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068431104:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387194:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068430976:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387244:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744207.387326:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068431488:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387368:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744207.387410:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744207.387417:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068430848:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387467:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744207.387643:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387669:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744207.387704:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431488 00000100:00100000:1.0:1788744207.387727:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431488 00000100:00100000:1.0:1788744207.387794:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744207.387805:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387867:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068431488:12345-0@lo:400:kworker.0 Request processed in 63us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744207.387874:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744207.387900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430848 00000100:00100000:1.0:1788744207.387905:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430848 00000100:00100000:1.0:1788744207.387927:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788744207.387933:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068430848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.387959:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068430848:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744207.387965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788744207.387992:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068430976 00000100:00100000:1.0:1788744207.387995:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068430976 00000100:00100000:1.0:1788744207.388018:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431360 00000100:00100000:1.0:1788744207.388021:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431360 00000100:00100000:1.0:1788744207.388039:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744207.388044:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068430976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.388100:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068430976:12345-0@lo:400:kworker.0 Request processed in 48us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744207.388106:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744207.388118:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788744207.388131:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.388157:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068431360:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744207.388162:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788744207.388179:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744207.388184:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744207.388220:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068430848:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.388234:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788744207.388242:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068430976:0@lo:400:kworker.0 00010000:00080000:1.0:1788744207.388253:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeadc00 x1875634068431488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744207.388264:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068431488:0@lo:400:kworker.0 00000100:00100000:0.0:1788744207.389012:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744207.389157:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744207.389170:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068431232:0@lo:400:kworker.0 00000100:00100000:0.0:1788744207.389214:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744207.389257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431104 00000100:00100000:0.0:1788744207.389262:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431104 00000100:00100000:0.0:1788744207.389326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788744207.389334:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068431104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744207.389659:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431232 00000100:00100000:3.0:1788744207.389665:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431232 00000100:00100000:3.0:1788744207.389906:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744207.389918:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068431232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744207.389986:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068431232:12345-0@lo:400:kworker.0 Request processed in 72us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744207.389994:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788744207.390037:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaed80 x1875634068431232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744207.390052:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068431232:0@lo:400:kworker.0 00000100:00080000:0.0:1788744207.402173:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744207.402183:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744207.402297:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068431104:12345-0@lo:400:kworker.0 Request processed in 12957us (13282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744207.402311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788744207.405005:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744207.405041:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068431616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744207.405164:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744207.405234:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431616 00000100:00100000:3.0:1788744207.405245:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431616 00000100:00100000:3.0:1788744207.405300:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744207.405311:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068431616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744207.405391:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744207.405442:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068431616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744207.405450:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788744207.405516:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeac380 x1875634068431616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744207.405541:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068431616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744207.405604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068431104:0@lo:400:kworker.0 00000001:02000400:3.0:1788744207.965645:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.44 00010000:00010000:2.0:1788744208.028351:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744208.411254:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068431744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744208.411357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744208.412366:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431744 00000100:00100000:0.0:1788744208.412376:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431744 00000100:00100000:0.0:1788744208.412448:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744208.412458:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068431744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744208.412505:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744208.412590:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068431744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744208.412598:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788744208.412792:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeac700 x1875634068431744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744208.412924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068431744:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788744209.052323:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744210.100483:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744211.163569:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744211.953077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744211.953155:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744211.953195:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047426944 00000100:00100000:3.0:1788744211.953207:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047426944 00000100:00100000:3.0:1788744211.953257:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 204 00000100:00100000:3.0:1788744211.953267:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047426944:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744211.953341:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047426944:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744211.953348:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 204 00000100:00100000:3.0:1788744211.953379:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427072 00000100:00100000:3.0:1788744211.953383:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427072 00000100:00100000:3.0:1788744211.954317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:3.0:1788744211.954325:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427072:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744211.954375:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427072:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 51us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744211.954382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00080000:3.0:1788744211.954656:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744212.189361:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744212.213673:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.44 00000100:00100000:0.0:1788744212.513731:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068432256:0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.513852:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744212.513911:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744212.513918:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068432128:0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.513959:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744212.514008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432128 00000100:00100000:0.0:1788744212.514016:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432128 00000100:00100000:0.0:1788744212.514088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744212.514098:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514246:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068432000:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514495:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744212.514539:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068432512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514614:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744212.514646:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744212.514651:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068431872:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744212.514699:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514718:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744212.514744:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432256 00000100:00100000:1.0:1788744212.514748:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432256 00000100:00100000:1.0:1788744212.514783:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432512 00000100:00100000:1.0:1788744212.514786:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432512 00000100:00100000:1.0:1788744212.514804:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744212.514811:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068432256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514853:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068432256:12345-0@lo:400:kworker.0 Request processed in 42us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744212.514860:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744212.514874:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788744212.514880:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068432512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.514909:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068432512:12345-0@lo:400:kworker.0 Request processed in 29us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744212.514914:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788744212.514956:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeadc00 x1875634068432256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744212.514970:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068432256:0@lo:400:kworker.0 00010000:00080000:1.0:1788744212.515016:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeac000 x1875634068432512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744212.515025:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068432512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.515062:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432000 00000100:00100000:1.0:1788744212.515066:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432000 00000100:00100000:1.0:1788744212.515083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432384 00000100:00100000:1.0:1788744212.515085:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432384 00000100:00100000:1.0:1788744212.515099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744212.515105:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068432000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.515959:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068432128:12345-0@lo:400:kworker.0 Request processed in 1860us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744212.515967:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788744212.516001:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744212.516010:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068432384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.516045:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068432384:12345-0@lo:400:kworker.0 Request processed in 38us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744212.516050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788744212.518088:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068432000:12345-0@lo:400:kworker.0 Request processed in 2974us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744212.518119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744212.518425:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.518460:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.518470:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068432000:0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.518787:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068431872 00000100:00100000:0.0:1788744212.518795:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068431872 00000100:00100000:0.0:1788744212.518855:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788744212.518865:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068431872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744212.518929:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068431872:12345-0@lo:400:kworker.0 Request processed in 66us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744212.518936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:0.0:1788744212.518969:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744212.518974:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744212.518977:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744212.519436:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068431872:0@lo:400:kworker.0 00000100:00100000:1.0:1788744212.521453:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068432640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744212.521523:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744212.521936:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432640 00000100:00100000:0.0:1788744212.521945:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432640 00000100:00100000:0.0:1788744212.522012:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744212.522022:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068432640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744212.522075:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1788744212.522385:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaf800 x1875634068432640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744212.522405:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068432640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744212.522790:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068432640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 769us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744212.522797:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788744213.214244:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744213.532958:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068432768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744213.533046:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744213.533574:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432768 00000100:00100000:0.0:1788744213.533583:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432768 00000100:00100000:0.0:1788744213.533631:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744213.533642:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068432768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744213.533681:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744213.533732:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068432768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744213.533739:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788744213.533776:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaca80 x1875634068432768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744213.533796:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068432768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744214.235690:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744215.258938:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744216.284827:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744216.625134:0:9438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.44 00000100:00100000:3.0:1788744217.063108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744217.063155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744217.063254:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427200 00000100:00100000:1.0:1788744217.063264:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427200 00000100:00100000:1.0:1788744217.063317:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 206 00000100:00100000:1.0:1788744217.063326:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047427200:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744217.063404:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047427200:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744217.063411:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 206 00000100:00100000:0.0:1788744217.064923:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427328 00000100:00100000:0.0:1788744217.064932:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427328 00000100:00100000:0.0:1788744217.065003:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:0.0:1788744217.065012:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427328:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744217.065081:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427328:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 70us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744217.065088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00080000:3.0:1788744217.065245:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744217.308596:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744217.627319:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788744217.627390:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744217.627460:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744217.627467:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744217.627493:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744217.627525:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433280 00000100:00100000:3.0:1788744217.627533:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433280 00000100:00100000:3.0:1788744217.627625:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744217.627634:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744217.627686:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068433280:12345-0@lo:400:kworker.0 Request processed in 54us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744217.627693:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788744217.627718:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744217.627744:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cc700 x1875634068433280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744217.627757:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068433280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628214:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068433024:0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628249:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744217.628268:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068433536:0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628303:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744217.628345:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744217.628361:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068432896:0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628389:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744217.628410:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068433408:0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628432:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744217.628457:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433536 00000100:00100000:1.0:1788744217.628461:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433536 00000100:00100000:1.0:1788744217.628491:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744217.628498:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068433536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628536:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068433536:12345-0@lo:400:kworker.0 Request processed in 39us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744217.628542:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744217.628579:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068432896 00000100:00100000:1.0:1788744217.628583:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068432896 00000100:00100000:1.0:1788744217.628607:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788744217.628613:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068432896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744217.628641:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068432896:12345-0@lo:400:kworker.0 Request processed in 28us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744217.628646:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788744217.628696:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068432896:0@lo:400:kworker.0 00010000:00080000:1.0:1788744217.628707:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cd500 x1875634068433536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744217.628717:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068433536:0@lo:400:kworker.0 00000100:00100000:0.0:1788744217.629627:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433152 00000100:00100000:0.0:1788744217.629635:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433152 00000100:00100000:0.0:1788744217.629682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433024 00000100:00100000:0.0:1788744217.629686:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433024 00000100:00100000:0.0:1788744217.629697:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433408 00000100:00100000:0.0:1788744217.629699:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433408 00000100:00100000:0.0:1788744217.629714:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744217.629721:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068433152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744217.629783:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068433152:12345-0@lo:400:kworker.0 Request processed in 53us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744217.629791:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744217.629807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744217.629814:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068433024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744217.629846:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068433024:12345-0@lo:400:kworker.0 Request processed in 32us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744217.629852:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788744217.629862:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744217.629868:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068433408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744217.629906:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068433408:12345-0@lo:400:kworker.0 Request processed in 39us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744217.629912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744217.629946:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068433408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744217.629957:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068433024:0@lo:400:kworker.0 00000100:00080000:3.0:1788744217.632191:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744217.632198:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744217.632256:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788744217.632279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744217.632298:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068433664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744217.632351:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744217.633802:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433664 00000100:00100000:0.0:1788744217.633812:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433664 00000100:00100000:0.0:1788744217.633878:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788744217.633898:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068433664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744217.633944:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744217.634030:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068433664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (1677us total) trans 0 rc 0/0 00010000:00080000:2.0:1788744217.634136:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cca80 x1875634068433664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744217.634153:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068433664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744217.634257:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1788744218.333202:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744218.652057:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744218.652082:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068433792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744218.652158:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744218.652239:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433792 00000100:00100000:0.0:1788744218.652246:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433792 00000100:00100000:0.0:1788744218.652290:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788744218.652300:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068433792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744218.652343:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744218.652383:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068433792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744218.652391:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788744218.652433:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaca80 x1875634068433792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744218.652451:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068433792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744219.362266:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744219.438608:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 21:23:36 EDT 2026 00010000:00010000:1.0:1788744220.383276:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744221.406459:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744222.188386:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744222.188435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744222.188648:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427584 00000100:00100000:0.0:1788744222.188659:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427584 00000100:00080000:2.0:1788744222.188718:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744222.188719:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:0.0:1788744222.188736:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427584:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744222.188857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427456 00000100:00100000:3.0:1788744222.188861:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427456 00000100:00100000:0.0:1788744222.188861:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047427584:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 133us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744222.188869:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:3.0:1788744222.194311:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 208 00000100:00100000:3.0:1788744222.194444:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047427456:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744222.194524:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047427456:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 199us (6148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.194532:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 208 00010000:00010000:2.0:1788744222.437387:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744222.753056:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068433920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753125:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753175:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068434432:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753229:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788744222.753235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068434048:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753256:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753272:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753295:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753323:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753365:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744222.753378:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744222.753436:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068433920 00000100:00100000:3.0:1788744222.753444:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068433920 00000100:00100000:3.0:1788744222.753488:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788744222.753497:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068433920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753546:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068433920:12345-0@lo:400:kworker.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.753571:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788744222.753604:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434432 00000100:00100000:3.0:1788744222.753608:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434432 00000100:00100000:3.0:1788744222.753647:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434048 00000100:00100000:3.0:1788744222.753651:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434048 00000100:00100000:3.0:1788744222.753661:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434176 00000100:00100000:3.0:1788744222.753663:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434176 00000100:00100000:3.0:1788744222.753677:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744222.753683:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068434432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753714:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068434432:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.753720:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744222.753732:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744222.753738:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068434048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753763:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068434048:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.753768:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788744222.753780:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744222.753799:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068434176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753842:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068434176:12345-0@lo:400:kworker.0 Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.753847:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744222.753867:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434560 00000100:00100000:3.0:1788744222.753870:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434560 00000100:00100000:3.0:1788744222.753893:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434304 00000100:00100000:3.0:1788744222.753896:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434304 00000100:00100000:3.0:1788744222.753915:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744222.753920:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068434560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753950:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068434560:12345-0@lo:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.753955:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744222.753966:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788744222.753972:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068434304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.753996:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068434304:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744222.754001:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788744222.754060:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cfb80 x1875634068434304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744222.754074:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068434304:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.754085:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068434176:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.754113:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068434048:0@lo:400:kworker.0 00010000:00080000:3.0:1788744222.754121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cce00 x1875634068434560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744222.754130:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068434560:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.754146:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068433920:0@lo:400:kworker.0 00000100:00100000:3.0:1788744222.754156:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068434432:0@lo:400:kworker.0 00000100:00080000:0.0:1788744222.757606:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744222.757617:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744222.757620:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744222.761641:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744222.761664:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068434688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744222.761733:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744222.761793:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434688 00000100:00100000:0.0:1788744222.761801:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434688 00000100:00100000:0.0:1788744222.761846:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744222.761857:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068434688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744222.761892:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744222.761935:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068434688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744222.761942:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788744222.761987:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaca80 x1875634068434688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744222.762006:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068434688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788744223.451353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744223.770750:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744223.770783:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068434816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744223.770856:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744223.770945:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434816 00000100:00100000:0.0:1788744223.770954:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434816 00000100:00100000:0.0:1788744223.771010:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744223.771019:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068434816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744223.771073:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744223.771118:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068434816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744223.771147:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788744223.771198:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaca80 x1875634068434816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744223.771218:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068434816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788744224.475676:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744225.498660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744226.524093:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744227.320122:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744227.320432:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427840 00000100:00100000:3.0:1788744227.320448:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427840 00000100:00100000:1.0:1788744227.321162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744227.321508:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:3.0:1788744227.321520:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047427840:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744227.321763:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047427840:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 245us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744227.321773:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00080000:1.0:1788744227.322654:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744227.323250:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427712 00000100:00100000:0.0:1788744227.323273:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427712 00000100:00100000:0.0:1788744227.323377:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 210 00000100:00100000:0.0:1788744227.323389:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047427712:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744227.323478:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2354:x1875634047427712:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 92us (2321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744227.323486:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 210 00010000:00010000:1.0:1788744227.551760:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744227.867744:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068435200:0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.868084:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068434944:0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.868134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744227.868199:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.868231:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068435072:0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.868271:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068434944 00000100:00100000:3.0:1788744227.868281:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068434944 00000100:00100000:3.0:1788744227.868344:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788744227.868355:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.868432:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068434944:12345-0@lo:400:kworker.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744227.868451:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788744227.870350:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744227.870752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435200 00000100:00100000:3.0:1788744227.871366:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435200 00000100:00100000:3.0:1788744227.871473:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744227.871487:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068435200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744227.874345:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744227.874718:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788744227.875055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744227.875103:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744227.875111:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744227.875141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.878345:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068435584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744227.878570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744227.878662:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435328 00000100:00100000:1.0:1788744227.878676:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435328 00000100:00100000:1.0:1788744227.878832:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435584 00000100:00100000:1.0:1788744227.878837:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435584 00000100:00100000:2.0:1788744227.879119:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744227.879133:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744227.879546:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068435328:12345-0@lo:400:kworker.0 Request processed in 415us (4489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.879581:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788744227.879614:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788744227.879893:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744227.879900:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744227.879903:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744227.879919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435072 00000100:00100000:3.0:1788744227.879928:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435072 00000100:00100000:0.0:1788744227.879940:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435712 00000100:00100000:0.0:1788744227.879948:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435712 00000100:00100000:0.0:1788744227.879985:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744227.879991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744227.879996:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068435712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744227.880005:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068435072:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788744227.880038:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744227.880070:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068435072:12345-0@lo:400:kworker.0 Request processed in 68us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744227.880072:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.880083:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744227.880091:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068435712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (4946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744227.880100:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788744227.880125:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068435584:12345-0@lo:400:kworker.0 Request processed in 503us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744227.880127:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744227.880139:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788744227.880215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435456 00000100:00100000:1.0:1788744227.880220:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435456 00000100:00100000:1.0:1788744227.880265:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744227.880273:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068435456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788744227.880280:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744227.880320:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068434944:0@lo:400:kworker.0 00010000:00080000:2.0:1788744227.883169:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cea00 x1875634068435712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744227.883208:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435712:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788744227.883228:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeac000 x1875634068435328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744227.883238:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435328:0@lo:400:kworker.0 00000100:00100000:2.0:1788744227.883313:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068435072:0@lo:400:kworker.0 00010000:00080000:2.0:1788744227.883327:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6d500 x1875634068435584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744227.883336:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744227.895251:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068435456:12345-0@lo:400:kworker.0 Request processed in 14954us (15100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744227.895272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788744227.895282:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068435456:0@lo:400:kworker.0 00000100:00100000:3.0:1788744227.903229:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068435200:12345-0@lo:400:kworker.0 Request processed in 31729us (35362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744227.903250:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744227.903366:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068435200:0@lo:400:kworker.0 00010000:00010000:2.0:1788744228.573215:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744228.890790:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744228.890891:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744228.891305:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435840 00000100:00100000:0.0:1788744228.891315:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435840 00000100:00100000:0.0:1788744228.891375:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744228.891386:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068435840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744228.891430:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744228.891497:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068435840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744228.891504:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788744228.891744:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6c380 x1875634068435840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744228.891769:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068435840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744229.598968:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744230.619984:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744231.643744:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744232.426957:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744232.426999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428096 00000100:00100000:3.0:1788744232.427009:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428096 00000100:00100000:3.0:1788744232.427090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00080000:2.0:1788744232.427452:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744232.430195:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047428096:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744232.430297:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047428096:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 3197us (3347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744232.430307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:3.0:1788744232.441230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744232.442658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047427968 00000100:00100000:1.0:1788744232.442670:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047427968 00000100:00100000:1.0:1788744232.442732:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 212 00000100:00100000:1.0:1788744232.442743:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047427968:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744232.442832:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047427968:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 91us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744232.442839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 212 00010000:00010000:1.0:1788744232.678439:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744232.987605:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068436224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744232.987694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744232.987775:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744232.987782:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744232.987811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744232.987885:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436224 00000100:00100000:2.0:1788744232.987892:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436224 00000100:00100000:2.0:1788744232.987948:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744232.987958:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068436224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744232.988009:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068436224:12345-0@lo:400:kworker.0 Request processed in 52us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744232.988017:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744232.988041:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436352 00000100:00100000:2.0:1788744232.988044:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436352 00000100:00100000:2.0:1788744232.988072:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788744232.988079:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068436352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744232.988110:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068436352:12345-0@lo:400:kworker.0 Request processed in 31us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744232.988116:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788744232.988131:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744232.988136:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744232.988144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744232.988152:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068436736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744232.988179:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744232.988213:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436736 00000100:00100000:2.0:1788744232.988225:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436736 00000100:00100000:2.0:1788744232.988273:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788744232.988279:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068436736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744232.988315:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744232.988349:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068436736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744232.988355:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788744232.988372:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788744232.988398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad817b100 x1875634068436736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744232.988417:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068436736:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788744232.988446:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8179880 x1875634068436352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744232.988454:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068436352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744232.988462:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068436224:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.988787:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068436096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.988822:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744232.988840:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068436608:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.988861:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744232.988882:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744232.988888:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.988913:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744232.988939:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068436480:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.988959:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744232.988984:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436096 00000100:00100000:3.0:1788744232.988988:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436096 00000100:00100000:3.0:1788744232.989012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436480 00000100:00100000:3.0:1788744232.989014:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436480 00000100:00100000:3.0:1788744232.989033:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744232.989039:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068436096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989075:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068436096:12345-0@lo:400:kworker.0 Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744232.989082:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788744232.989095:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744232.989101:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068436480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989126:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068436480:12345-0@lo:400:kworker.0 Request processed in 26us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744232.989132:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744232.989149:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436608 00000100:00100000:3.0:1788744232.989152:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436608 00000100:00100000:3.0:1788744232.989183:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744232.989188:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068436608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989218:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068436608:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744232.989223:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744232.989253:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068435968 00000100:00100000:3.0:1788744232.989257:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068435968 00000100:00100000:3.0:1788744232.989283:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788744232.989289:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068435968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989319:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068435968:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744232.989325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1788744232.989353:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744232.989374:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068435968:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989385:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068436480:0@lo:400:kworker.0 00000100:00100000:3.0:1788744232.989392:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068436096:0@lo:400:kworker.0 00010000:00080000:3.0:1788744232.989401:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8179f80 x1875634068436608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744232.989409:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068436608:0@lo:400:kworker.0 00010000:00010000:1.0:1788744233.691189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744234.011872:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068436864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744234.011962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744234.012040:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436864 00000100:00100000:1.0:1788744234.012048:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436864 00000100:00100000:1.0:1788744234.012104:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744234.012114:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068436864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744234.012150:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744234.012196:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068436864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744234.012203:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788744234.012225:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788744234.012254:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6ca80 x1875634068436864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744234.012271:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068436864:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788744234.715468:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744235.742508:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744236.769638:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744237.550975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744237.551028:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744237.551483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428352 00000100:00100000:0.0:1788744237.551516:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428352 00000100:00080000:3.0:1788744237.551668:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744237.551810:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:0.0:1788744237.551828:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047428352:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744237.552014:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047428352:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 191us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744237.552025:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:1.0:1788744237.554285:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428224 00000100:00100000:1.0:1788744237.554310:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428224 00000100:00100000:1.0:1788744237.554408:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 214 00000100:00100000:1.0:1788744237.554422:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047428224:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744237.554531:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047428224:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 111us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744237.554540:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 214 00010000:00010000:3.0:1788744237.786895:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744238.107141:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744238.107231:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744238.107352:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068436992 00000100:00100000:1.0:1788744238.107367:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068436992 00000100:00100000:1.0:1788744238.107434:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744238.107444:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068436992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744238.107503:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788744238.107633:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744238.109099:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068437120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744238.109160:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744238.109242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437120 00000100:00100000:2.0:1788744238.109249:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437120 00000100:00100000:2.0:1788744238.109293:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788744238.109301:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068437120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744238.109347:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068437120:12345-0@lo:400:kworker.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744238.109353:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788744238.109407:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068437120:0@lo:400:kworker.0 00010000:00080000:3.0:1788744238.113766:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8179880 x1875634068436992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744238.113766:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068436992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6306us (6517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744238.113790:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788744238.113806:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068436992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744238.117177:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068437632:0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117259:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744238.117304:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744238.117311:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068437504:0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117338:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744238.117370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437632 00000100:00100000:0.0:1788744238.117378:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437632 00000100:00100000:0.0:1788744238.117439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744238.117449:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068437632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117532:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068437632:12345-0@lo:400:kworker.0 Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744238.117575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788744238.117599:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437504 00000100:00100000:0.0:1788744238.117603:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437504 00000100:00100000:0.0:1788744238.117633:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788744238.117640:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068437504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117679:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068437504:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744238.117686:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788744238.117694:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068437248:0@lo:400:kworker.0 00000100:00080000:0.0:1788744238.117712:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744238.117728:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744238.117735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788744238.117757:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6e680 x1875634068437504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744238.117764:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744238.117776:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068437504:0@lo:400:kworker.0 00000100:00100000:2.0:1788744238.117780:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068437376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117794:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068437632:0@lo:400:kworker.0 00000100:00100000:2.0:1788744238.117811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744238.117827:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437248 00000100:00100000:0.0:1788744238.117833:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437248 00000100:00100000:0.0:1788744238.117857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437376 00000100:00100000:0.0:1788744238.117860:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437376 00000100:00100000:0.0:1788744238.117909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744238.117915:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068437248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.117950:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068437248:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744238.117955:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788744238.117967:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744238.117972:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068437376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.118006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068437376:12345-0@lo:400:kworker.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744238.118011:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744238.118037:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068437376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744238.118046:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068437248:0@lo:400:kworker.0 00000100:00080000:2.0:1788744238.118627:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744238.813083:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788744238.932709:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:23:57 (1788744237) === 00000100:00100000:1.0:1788744239.133849:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744239.133873:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068437760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744239.133948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744239.134077:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437760 00000100:00100000:2.0:1788744239.134086:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437760 00000100:00100000:2.0:1788744239.134144:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744239.134155:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068437760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744239.134204:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744239.134259:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068437760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.134265:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788744239.134408:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6f800 x1875634068437760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744239.134435:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068437760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744239.539184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.539281:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428480 00000100:00100000:3.0:1788744239.539292:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428480 00000100:00100000:3.0:1788744239.539350:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 216 00000100:00100000:3.0:1788744239.539365:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:8134:x1875634047428480:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788744239.539383:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744239.539400:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b946d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610c5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744239.539430:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b946d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610c5 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744239.539442:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b946d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610c5 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744239.539450:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fda00, rc 0) 00000100:00100000:3.0:1788744239.539746:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047428480:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 386us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.539770:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 216 00000100:00100000:2.0:1788744239.547445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744239.547527:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428608 00000100:00100000:1.0:1788744239.547537:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428608 00000100:00100000:1.0:1788744239.547670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 217 00000100:00100000:1.0:1788744239.547684:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047428608:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788744239.548198:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047428608:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 515us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744239.548208:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 217 00000100:00100000:1.0:1788744239.551183:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.553492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428736 00000100:00100000:3.0:1788744239.553589:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428736 00000100:00100000:3.0:1788744239.554032:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 218 00000100:00100000:3.0:1788744239.554046:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047428736:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788744239.554700:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047428736:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 655us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.554709:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 218 00000100:00100000:2.0:1788744239.565632:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744239.565741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428864 00000100:00100000:1.0:1788744239.565752:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428864 00000100:00100000:1.0:1788744239.565808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 219 00000100:00100000:1.0:1788744239.565819:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8138:x1875634047428864:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744239.566113:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8138:x1875634047428864:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 296us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744239.566121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 219 00000100:00100000:0.0:1788744239.592542:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.594392:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047428992 00000100:00100000:3.0:1788744239.594407:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047428992 00000100:00100000:3.0:1788744239.594691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 220 00000100:00100000:3.0:1788744239.594702:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8138:x1875634047428992:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744239.596520:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8138:x1875634047428992:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 1808us (3975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.596534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 220 00000100:00100000:3.0:1788744239.603545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744239.604220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429120 00000100:00100000:2.0:1788744239.604231:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429120 00000100:00100000:2.0:1788744239.604298:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 221 00000100:00100000:2.0:1788744239.604309:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:8134:x1875634047429120:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744239.604325:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744239.604344:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7389200/0x7cd2bfd5e1b946d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610ef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.604374:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389200/0x7cd2bfd5e1b946d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610ef expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.604406:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7389200/0x7cd2bfd5e1b946d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610ef expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.604416:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389200, rc 0) 00000100:00100000:2.0:1788744239.604495:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:8134:x1875634047429120:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 187us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.605142:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 221 00000100:00100000:2.0:1788744239.607843:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.608031:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429248 00000100:00100000:3.0:1788744239.608045:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429248 00000100:00100000:3.0:1788744239.608155:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 222 00000100:00100000:3.0:1788744239.608166:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:8134:x1875634047429248:12345-192.168.204.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788744239.608191:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788744239.608216:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788744239.608220:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788744239.608223:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788744239.608225:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788744239.621924:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:8134:x1875634047429248:12345-192.168.204.56@tcp:256:mount.lustre.0 Request processed in 13744us (14073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.621940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 222 00000100:00100000:0.0:1788744239.631997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744239.632084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429376 00000100:00100000:2.0:1788744239.632094:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429376 00000100:00100000:2.0:1788744239.632151:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 223 00000100:00100000:2.0:1788744239.632162:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:8134:x1875634047429376:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744239.632180:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744239.632199:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57610f6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.632235:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.632247:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744239.632257:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388a00, rc 0) 00000100:00100000:2.0:1788744239.632330:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8134:x1875634047429376:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 169us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.632338:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 223 00000100:00100000:2.0:1788744239.635154:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.636200:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429504 00000100:00100000:3.0:1788744239.636211:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429504 00000100:00100000:3.0:1788744239.636274:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 224 00000100:00100000:3.0:1788744239.636282:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8134:x1875634047429504:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788744239.636961:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8134:x1875634047429504:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 677us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.636970:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 224 00000100:00100000:0.0:1788744239.643514:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744239.643682:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429632 00000100:00100000:1.0:1788744239.643692:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429632 00000100:00100000:1.0:1788744239.643743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 225 00000100:00100000:1.0:1788744239.643754:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8134:x1875634047429632:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788744239.644000:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8134:x1875634047429632:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 246us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744239.644009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 225 00000100:00100000:0.0:1788744239.647417:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.647592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429760 00000100:00100000:3.0:1788744239.647603:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429760 00000100:00100000:3.0:1788744239.647667:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 226 00000100:00100000:3.0:1788744239.647678:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8140:x1875634047429760:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788744239.647929:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8140:x1875634047429760:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 252us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.647938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 226 00000100:00100000:1.0:1788744239.651527:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744239.651823:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047429888 00000100:00100000:0.0:1788744239.651838:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047429888 00000100:00100000:0.0:1788744239.651906:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 227 00000100:00100000:0.0:1788744239.651918:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8140:x1875634047429888:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744239.652182:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:8140:x1875634047429888:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 266us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744239.652191:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 227 00000100:00100000:0.0:1788744239.660817:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744239.660931:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430400 00000100:00100000:2.0:1788744239.660942:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430400 00000100:00100000:2.0:1788744239.661024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:2.0:1788744239.661036:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047430400:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744239.661121:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047430400:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 87us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.661129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00080000:0.0:1788744239.666641:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744239.673481:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744239.673979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430016 00000100:00100000:0.0:1788744239.673990:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430016 00000100:00100000:0.0:1788744239.674045:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:0.0:1788744239.674054:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1875634047430016:12345-192.168.204.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788744239.674085:0:5838:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 9c98c4d6-e812-4ea8-bad5-ea714521aba0@192.168.204.56@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:0.0:1788744239.674122:0:5838:0:(genops.c:1384:class_connect()) connect: client 9c98c4d6-e812-4ea8-bad5-ea714521aba0, cookie 0x7cd2bfd5e1b946e7 00000004:00100000:0.0:1788744239.674151:0:5838:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788744239.674481:0:5838:0:(import.c:65:import_set_state_nolock()) ffff940af78a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744239.676019:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2350:x1875634047430016:12345-192.168.204.56@tcp:38:mount.lustre.0 Request processed in 1957us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744239.676033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:3.0:1788744239.684105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.684150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744239.684359:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430144 00000100:00100000:2.0:1788744239.684369:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430144 00000100:00100000:2.0:1788744239.684533:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430272 00000100:00100000:2.0:1788744239.684537:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430272 00000100:00080000:0.0:1788744239.684635:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744239.692382:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:3.0:1788744239.692411:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+7:0:x1875634047430144:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788744239.692475:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788744239.692902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:1.0:1788744239.692914:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+7:8134:x1875634047430272:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788744239.692933:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788744239.693044:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+7:8134:x1875634047430272:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 133us (8893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744239.693051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744239.693934:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:0:x1875634047430144:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 1535us (9836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.693943:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:1.0:1788744239.698446:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744239.698697:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430528 00000100:00100000:0.0:1788744239.698708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430528 00000100:00100000:0.0:1788744239.699174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:0.0:1788744239.699185:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:8134:x1875634047430528:12345-192.168.204.56@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744239.699324:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:8134:x1875634047430528:12345-192.168.204.56@tcp:40:mount.lustre.0 Request processed in 140us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744239.699333:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:0.0:1788744239.704166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744239.704261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744239.704293:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744239.704371:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430656 00000100:00100000:3.0:1788744239.704381:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430656 00000100:00100000:3.0:1788744239.704426:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430784 00000100:00100000:3.0:1788744239.704429:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430784 00000100:00100000:3.0:1788744239.704471:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744239.704480:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875634047430656:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744239.704519:0:6681:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 9c98c4d6-e812-4ea8-bad5-ea714521aba0@192.168.204.56@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1788744239.704586:0:6681:0:(genops.c:1384:class_connect()) connect: client 9c98c4d6-e812-4ea8-bad5-ea714521aba0, cookie 0x7cd2bfd5e1b946ee 00002000:00100000:3.0:1788744239.704597:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9c98c4d6-e812-4ea8-bad5-ea714521aba0/ffff940af773f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744239.704618:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788744239.704869:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788744239.704899:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940af7738000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744239.704962:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2350:x1875634047430656:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 481us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.704970:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744239.704990:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:3.0:1788744239.704995:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875634047430784:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788744239.705013:0:6681:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 9c98c4d6-e812-4ea8-bad5-ea714521aba0@192.168.204.56@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1788744239.705261:0:6681:0:(genops.c:1384:class_connect()) connect: client 9c98c4d6-e812-4ea8-bad5-ea714521aba0, cookie 0x7cd2bfd5e1b946f5 00002000:00100000:3.0:1788744239.705267:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9c98c4d6-e812-4ea8-bad5-ea714521aba0/ffff940af7738800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788744239.705274:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788744239.705405:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788744239.705421:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940af773a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788744239.705447:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2350:x1875634047430784:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 450us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744239.705454:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:2.0:1788744239.708191:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047430912 00000100:00100000:2.0:1788744239.708206:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047430912 00000100:00100000:2.0:1788744239.708335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744239.708347:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:8134:x1875634047430912:12345-192.168.204.56@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788744239.708437:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744239.708591:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:8134:x1875634047430912:12345-192.168.204.56@tcp:33:mount.lustre.0 Request processed in 245us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744239.708599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00010000:00010000:3.0:1788744239.835041:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744240.860833:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744241.738504:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000001:00100000:1.0:1788744241.741063:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00010000:00010000:3.0:1788744241.883848:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744242.241856:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00010000:00010000:3.0:1788744242.907312:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744243.231720:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068437888:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.231792:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.231855:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068438400:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.231883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.231910:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744243.231916:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.231940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.231966:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068438016:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.231989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.232007:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068438528:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.232045:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744243.232050:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068438144:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232069:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744243.232096:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438400 00000100:00100000:3.0:1788744243.232104:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438400 00000100:00100000:3.0:1788744243.232155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438016 00000100:00100000:3.0:1788744243.232159:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438016 00000100:00100000:3.0:1788744243.232171:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438144 00000100:00100000:3.0:1788744243.232173:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438144 00000100:00100000:3.0:1788744243.232189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744243.232197:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068438400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232245:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068438400:12345-0@lo:400:kworker.0 Request processed in 48us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744243.232264:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744243.232281:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744243.232287:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068438016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232318:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068438016:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744243.232324:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744243.232334:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788744243.232340:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068438144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232361:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068438144:12345-0@lo:400:kworker.0 Request processed in 22us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744243.232382:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788744243.232409:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438272 00000100:00100000:3.0:1788744243.232413:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438272 00000100:00100000:3.0:1788744243.232437:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438528 00000100:00100000:3.0:1788744243.232440:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438528 00000100:00100000:3.0:1788744243.232457:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788744243.232463:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232491:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438272:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744243.232497:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788744243.232509:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788744243.232514:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068438528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232537:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068438528:12345-0@lo:400:kworker.0 Request processed in 23us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744243.232542:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788744243.232589:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788744243.232593:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744243.232595:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744243.232622:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068438144:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232631:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068438016:0@lo:400:kworker.0 00010000:00080000:3.0:1788744243.232655:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceead880 x1875634068438528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744243.232665:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068438528:0@lo:400:kworker.0 00010000:00080000:3.0:1788744243.232702:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeac380 x1875634068438272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744243.232710:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438272:0@lo:400:kworker.0 00000100:00100000:3.0:1788744243.232718:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068438400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744243.232837:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744243.232846:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744243.232879:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744243.232904:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438656 00000100:00100000:2.0:1788744243.232908:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438656 00000100:00100000:2.0:1788744243.232932:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744243.232938:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068438656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744243.232964:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744243.232998:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068438656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744243.233004:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788744243.233027:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8179880 x1875634068438656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744243.233039:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068438656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744243.239467:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068437888 00000100:00100000:1.0:1788744243.239492:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068437888 00000100:00100000:1.0:1788744243.239613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788744243.239625:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068437888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744243.239741:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068437888:12345-0@lo:400:kworker.0 Request processed in 118us (7949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744243.239749:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788744243.239836:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068437888:0@lo:400:kworker.0 00010000:00010000:3.0:1788744243.930849:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744244.252785:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744244.252823:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744244.252909:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744244.253437:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438784 00000100:00100000:2.0:1788744244.253446:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438784 00000100:00100000:2.0:1788744244.253517:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744244.253527:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744244.253604:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744244.254246:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 719us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744244.254273:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788744244.254323:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6f480 x1875634068438784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744244.254357:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744244.721631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744244.721681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744244.721712:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744244.721732:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744244.721754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744244.721784:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431040 00000100:00100000:0.0:1788744244.721793:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431040 00000100:00100000:0.0:1788744244.721840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 229 00000100:00100000:0.0:1788744244.721849:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047431040:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744244.721921:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047431040:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744244.721940:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 229 00000100:00100000:0.0:1788744244.721998:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431168 00000100:00100000:0.0:1788744244.722001:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431168 00000100:00100000:0.0:1788744244.722037:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431296 00000100:00100000:0.0:1788744244.722039:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431296 00000100:00100000:1.0:1788744244.722217:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431424 00000100:00100000:1.0:1788744244.722222:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431424 00000100:00100000:1.0:1788744244.722254:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431552 00000100:00100000:1.0:1788744244.722256:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431552 00000100:00100000:1.0:1788744244.722276:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:1.0:1788744244.722283:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431424:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744244.722313:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431424:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 31us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744244.722319:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:1.0:1788744244.722333:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:1.0:1788744244.722338:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431552:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744244.722370:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431552:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 22us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744244.722376:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00080000:1.0:1788744244.722588:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744244.722592:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744244.722595:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744244.722654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:0.0:1788744244.722946:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 83 00000100:00100000:2.0:1788744244.728677:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047431168:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744244.728973:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047431168:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 6309us (7349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744244.728985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:0.0:1788744244.735524:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431296:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744244.737790:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047431296:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 14827us (16047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744244.737806:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 83 00010000:00010000:2.0:1788744244.960910:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744245.756168:0:10314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788744245.984486:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744247.004625:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744248.029749:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744248.346787:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744248.346872:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744248.347047:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068438912 00000100:00100000:1.0:1788744248.347055:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068438912 00000100:00100000:1.0:1788744248.347109:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788744248.347120:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744248.347159:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744248.347218:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068438912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744248.347225:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788744248.347246:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744248.347844:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068439168:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.347882:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744248.347905:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068439040:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.348232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439168 00000100:00100000:2.0:1788744248.348239:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439168 00000100:00100000:2.0:1788744248.348277:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744248.348285:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068439168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744248.348955:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744248.349026:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439040 00000100:00100000:0.0:1788744248.349034:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439040 00000100:00100000:0.0:1788744248.349074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788744248.349083:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068439040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744248.350621:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068439552:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.350680:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068439168:12345-0@lo:400:kworker.0 Request processed in 2392us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744248.350689:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744248.350699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744248.350737:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439552 00000100:00100000:2.0:1788744248.350745:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439552 00000100:00100000:2.0:1788744248.350807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788744248.350818:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068439552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.350872:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068439552:12345-0@lo:400:kworker.0 Request processed in 56us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744248.350879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788744248.350907:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068439552:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.350932:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068439296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.350961:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744248.351002:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744248.351010:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068439424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.351040:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744248.351091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439296 00000100:00100000:2.0:1788744248.351097:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439424 00000100:00100000:1.0:1788744248.351097:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439296 00000100:00100000:2.0:1788744248.351103:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439424 00000100:00100000:1.0:1788744248.351135:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788744248.351145:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068439296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.351147:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744248.351161:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad81e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068439424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744248.351393:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068439296:12345-0@lo:400:kworker.0 Request processed in 250us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744248.351402:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788744248.351888:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068439040:12345-0@lo:400:kworker.0 Request processed in 2804us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744248.351898:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788744248.352251:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068439040:0@lo:400:kworker.0 00000100:00080000:3.0:1788744248.353468:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744248.353477:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744248.353518:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068439168:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.353648:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad81e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068439424:12345-0@lo:400:kworker.0 Request processed in 2487us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744248.353659:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788744248.353873:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace37b800 x1875634068439424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744248.353886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068439424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744248.353899:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068439296:0@lo:400:kworker.0 00010000:00080000:3.0:1788744248.353984:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad8179880 x1875634068438912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744248.354003:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068438912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788744249.051340:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744249.373705:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068439680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744249.373775:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744249.375239:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439680 00000100:00100000:1.0:1788744249.375251:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439680 00000100:00100000:1.0:1788744249.375388:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788744249.375401:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068439680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744249.375448:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744249.375516:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068439680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744249.375523:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788744249.375673:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cce00 x1875634068439680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744249.375696:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068439680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744249.834851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744249.834935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431680 00000100:00100000:2.0:1788744249.834946:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431680 00000100:00100000:2.0:1788744249.835011:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 231 00000100:00100000:2.0:1788744249.835023:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047431680:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744249.838426:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047431680:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 3392us (3569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744249.838442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 231 00000100:00100000:3.0:1788744249.842862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744249.843973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431808 00000100:00100000:3.0:1788744249.843985:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431808 00000100:00100000:3.0:1788744249.844068:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00100000:3.0:1788744249.844078:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047431808:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744249.844171:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047431808:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 94us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744249.844179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00080000:2.0:1788744249.844238:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744249.851576:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744249.851627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744249.851658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744249.851696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047431936 00000100:00100000:1.0:1788744249.851707:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047431936 00000100:00100000:1.0:1788744249.851768:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:1.0:1788744249.851777:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047431936:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744249.851846:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047431936:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 70us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744249.851853:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:1.0:1788744249.851876:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432064 00000100:00100000:1.0:1788744249.851880:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432064 00000100:00100000:1.0:1788744249.851901:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432192 00000100:00100000:1.0:1788744249.851903:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432192 00000100:00100000:1.0:1788744249.851927:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:1.0:1788744249.851933:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047432064:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744249.851957:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047432064:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744249.851964:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:1.0:1788744249.851975:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:1.0:1788744249.851980:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047432192:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744249.852003:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047432192:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744249.852691:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00080000:1.0:1788744249.852715:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744249.852730:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744249.852733:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744250.075891:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744251.100644:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744252.123392:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744253.151740:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744253.466837:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068439808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744253.467217:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744253.467441:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439808 00000100:00100000:1.0:1788744253.467454:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439808 00000100:00100000:1.0:1788744253.467582:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788744253.467594:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068439808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744253.467647:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744253.467712:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068439808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744253.467720:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788744253.468132:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788744253.468177:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cc000 x1875634068439808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744253.468214:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068439808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744253.468873:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068440064:0@lo:400:kworker.0 00000100:00100000:2.0:1788744253.468941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744253.469177:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068439936:0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.469235:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744253.469296:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068439936 00000100:00100000:0.0:1788744253.469306:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068439936 00000100:00100000:0.0:1788744253.469348:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788744253.469358:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068439936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.469413:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068439936:12345-0@lo:400:kworker.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744253.469420:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788744253.469466:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068439936:0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.469629:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440064 00000100:00100000:0.0:1788744253.469634:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440064 00000100:00100000:0.0:1788744253.469678:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788744253.469704:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068440064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.470022:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068440064:12345-0@lo:400:kworker.0 Request processed in 319us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744253.470030:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788744253.471348:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788744253.471430:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744253.471580:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440320 00000100:00100000:0.0:1788744253.471589:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440320 00000100:00100000:0.0:1788744253.471658:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788744253.471668:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068440320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744253.472715:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068440064:0@lo:400:kworker.0 00000100:00100000:2.0:1788744253.472768:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744253.472779:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068440192:0@lo:400:kworker.0 00000100:00100000:2.0:1788744253.472828:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744253.473028:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440192 00000100:00100000:2.0:1788744253.473036:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440192 00000100:00100000:2.0:1788744253.473085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744253.473107:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068440192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744253.473163:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068440192:12345-0@lo:400:kworker.0 Request processed in 69us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744253.473170:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788744253.473221:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068440192:0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.479090:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068440320:12345-0@lo:400:kworker.0 Request processed in 7404us (7640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744253.479203:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788744253.479288:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744253.479299:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744253.479328:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068440448:0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.479425:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744253.479510:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440448 00000100:00100000:0.0:1788744253.479520:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440448 00000100:00100000:0.0:1788744253.479707:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744253.479718:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068440448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744253.479796:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068440448:12345-0@lo:400:kworker.0 Request processed in 81us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744253.479803:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788744253.479821:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744253.479983:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068440448:0@lo:400:kworker.0 00010000:00080000:1.0:1788744253.482021:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace4cc000 x1875634068440320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744253.482044:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068440320:0@lo:400:kworker.0 00010000:00010000:2.0:1788744254.172853:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744254.491775:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068440576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744254.491903:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744254.492770:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440576 00000100:00100000:3.0:1788744254.492787:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440576 00000100:00100000:3.0:1788744254.492868:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744254.492881:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068440576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744254.492960:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744254.493051:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068440576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744254.493059:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788744254.493232:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeae300 x1875634068440576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744254.493258:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068440576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744254.954693:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744254.954748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744254.954787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744254.954810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744254.954839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744254.954887:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432704 00000100:00100000:1.0:1788744254.954902:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432704 00000100:00100000:1.0:1788744254.954976:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432832 00000100:00100000:1.0:1788744254.954990:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432832 00000100:00100000:1.0:1788744254.955017:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744254.955028:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432704:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744254.955129:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432704:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744254.955137:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744254.955486:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:1.0:1788744254.955494:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432832:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744254.955533:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432832:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 41us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744254.955539:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:1.0:1788744254.955583:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432320 00000100:00100000:1.0:1788744254.955587:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432320 00000100:00100000:1.0:1788744254.955616:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 233 00000100:00100000:1.0:1788744254.955623:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047432320:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744254.955647:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047432320:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 25us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744254.955653:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 233 00000100:00100000:1.0:1788744254.955681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432448 00000100:00100000:1.0:1788744254.955684:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432448 00000100:00100000:1.0:1788744254.955709:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432576 00000100:00100000:1.0:1788744254.955712:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432576 00000100:00100000:1.0:1788744254.955732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:1.0:1788744254.955738:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047432448:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744254.955764:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047432448:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 27us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744254.955778:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:1.0:1788744254.955790:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:1.0:1788744254.955796:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432576:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744254.955818:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047432576:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 23us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744254.955824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00080000:1.0:1788744254.955843:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744254.955848:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744254.955850:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788744255.197618:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744256.219351:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744257.253783:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744258.267679:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744258.586959:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068440960:0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.587043:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.587108:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068441472:0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.587137:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.587169:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788744258.587174:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.587203:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.587226:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068441344:0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.587625:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.587727:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440832 00000100:00100000:0.0:1788744258.587735:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440832 00000100:00100000:0.0:1788744258.587778:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788744258.587787:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068440832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.587840:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068440832:12345-0@lo:400:kworker.0 Request processed in 53us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744258.587848:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788744258.588281:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744258.588319:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744258.588343:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744258.588367:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744258.588388:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744258.588395:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068441088:0@lo:400:kworker.0 00000100:00100000:1.0:1788744258.588418:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744258.588489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068440832:0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.590325:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441472 00000100:00100000:0.0:1788744258.590339:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441472 00000100:00100000:0.0:1788744258.590400:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441216 00000100:00100000:0.0:1788744258.590404:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441216 00000100:00100000:0.0:1788744258.590430:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744258.590439:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.590520:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068441472:12345-0@lo:400:kworker.0 Request processed in 83us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744258.590527:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744258.590564:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744258.590570:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744258.590598:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441216:12345-0@lo:400:kworker.0 Request processed in 28us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744258.590603:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788744258.591729:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6c000 x1875634068441216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744258.591745:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441216:0@lo:400:kworker.0 00000100:00100000:1.0:1788744258.591785:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440704 00000100:00100000:1.0:1788744258.591791:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440704 00000100:00100000:1.0:1788744258.591831:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788744258.591838:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068440704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744258.591886:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744258.591943:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068440704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744258.591950:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788744258.591974:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744258.591978:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788744258.592926:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6f800 x1875634068441472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744258.592941:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068441472:0@lo:400:kworker.0 00000100:00100000:3.0:1788744258.593289:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068440960 00000100:00100000:3.0:1788744258.593300:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068440960 00000100:00100000:3.0:1788744258.593373:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441344 00000100:00100000:3.0:1788744258.593377:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441344 00000100:00080000:3.0:1788744258.593403:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744258.593446:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441088 00000100:00100000:3.0:1788744258.593450:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441088 00000100:00080000:3.0:1788744258.593465:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744258.593483:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788744258.593493:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068440960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744258.593848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788744258.593858:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068441344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744258.594005:0:5836:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788744258.594015:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788744258.594126:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068441344:12345-0@lo:400:kworker.0 Request processed in 270us (6500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744258.594134:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788744258.594151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744258.594157:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068441088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744258.594212:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068441088:12345-0@lo:400:kworker.0 Request processed in 55us (5793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744258.594218:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788744258.594252:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068441344:0@lo:400:kworker.0 00000100:00100000:3.0:1788744258.594430:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068440960:12345-0@lo:400:kworker.0 Request processed in 937us (7385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744258.594436:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788744258.594648:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068440960:0@lo:400:kworker.0 00010000:00080000:1.0:1788744258.597455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceead180 x1875634068440704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744258.597488:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744258.597528:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068441088:0@lo:400:kworker.0 00010000:00010000:2.0:1788744259.290960:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744259.611221:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744259.611247:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744259.611324:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744259.611400:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441600 00000100:00100000:2.0:1788744259.611409:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441600 00000100:00100000:2.0:1788744259.611461:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788744259.611470:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744259.611511:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744259.611587:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744259.611595:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788744259.611654:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace37aa00 x1875634068441600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744259.611672:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744260.078046:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744260.078150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744260.078184:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744260.078205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744260.078281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744260.078315:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433344 00000100:00100000:1.0:1788744260.078324:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433344 00000100:00100000:1.0:1788744260.078379:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433472 00000100:00100000:1.0:1788744260.078382:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433472 00000100:00100000:1.0:1788744260.078402:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:1.0:1788744260.078413:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2350:x1875634047433344:12345-192.168.204.56@tcp:9:kworker.0 00000020:00000080:1.0:1788744260.078449:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b946ee 00000100:00080000:1.0:1788744260.078457:0:6680:0:(import.c:65:import_set_state_nolock()) ffff940af7738000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744260.078497:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744260.078858:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+2:2350:x1875634047433344:12345-192.168.204.56@tcp:9:kworker.0 Request processed in 445us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744260.078876:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:1.0:1788744260.078893:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:1.0:1788744260.078900:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2350:x1875634047433472:12345-192.168.204.56@tcp:9:kworker.0 00000020:00000080:1.0:1788744260.078911:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b946f5 00000100:00080000:1.0:1788744260.078916:0:6680:0:(import.c:65:import_set_state_nolock()) ffff940af773a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744260.078936:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788744260.079134:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+2:2350:x1875634047433472:12345-192.168.204.56@tcp:9:kworker.0 Request processed in 234us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744260.079142:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00080000:1.0:1788744260.079163:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744260.079167:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744260.079181:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744260.079294:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744260.079856:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433216 00000100:00100000:3.0:1788744260.079865:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433216 00000100:00100000:3.0:1788744260.079910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433088 00000100:00100000:3.0:1788744260.079914:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433088 00000100:00100000:3.0:1788744260.079937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:3.0:1788744260.079946:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047433216:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744260.079990:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047433216:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 45us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.079997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:3.0:1788744260.080012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 98 00000100:00100000:3.0:1788744260.080018:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047433088:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744260.080052:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047433088:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 34us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744260.080058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 98 00000100:00080000:1.0:1788744260.080971:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744260.082116:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047432960 00000100:00100000:0.0:1788744260.082127:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047432960 00000100:00100000:0.0:1788744260.082185:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 235 00000100:00100000:0.0:1788744260.082194:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047432960:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744260.082515:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047432960:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 321us (4481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744260.082522:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 235 00010000:00010000:1.0:1788744260.317057:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744261.341381:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744262.213687:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000020:00000080:3.0:1788744262.213695:0:6708:0:(genops.c:885:class_export_put()) final put ffff940af773f800/9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000020:00000080:0.0:1788744262.214726:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af773f800/9c98c4d6-e812-4ea8-bad5-ea714521aba0 for lustre-OST0000 00000020:00000080:0.0:1788744262.214846:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af7738000 for lustre-OST0000 00010000:00010000:1.0:1788744262.363722:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788744262.731459:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000020:00000080:3.0:1788744262.731470:0:7639:0:(genops.c:885:class_export_put()) final put ffff940af7738800/9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000020:00000080:1.0:1788744262.731668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af7738800/9c98c4d6-e812-4ea8-bad5-ea714521aba0 for lustre-OST0001 00000020:00000080:1.0:1788744262.731715:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af773a800 for lustre-OST0001 00010000:00010000:1.0:1788744263.387749:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744263.489675:0:11017:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788744263.707075:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744263.707156:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744263.707333:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441728 00000100:00100000:3.0:1788744263.707342:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441728 00000100:00100000:3.0:1788744263.707410:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788744263.707421:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744263.707458:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744263.707512:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068441728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744263.707520:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788744263.707637:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788744263.708048:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940aceeaca80 x1875634068441728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744263.708071:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068441728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744263.708369:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068442240:0@lo:400:kworker.0 00000100:00100000:2.0:1788744263.708431:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744263.708456:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744263.708462:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068442112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744263.708489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744263.708577:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068441984:0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.708611:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744263.708634:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788744263.708639:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068441856:0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.708664:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744263.708690:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068442368:0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.708709:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744263.708738:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442112 00000100:00100000:3.0:1788744263.708744:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442112 00000100:00100000:3.0:1788744263.708792:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441984 00000100:00100000:3.0:1788744263.708795:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441984 00000100:00100000:3.0:1788744263.708818:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442368 00000100:00100000:3.0:1788744263.708820:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442368 00000100:00100000:3.0:1788744263.708835:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744263.708843:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068442112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.708889:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068442112:12345-0@lo:400:kworker.0 Request processed in 46us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744263.708895:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788744263.708909:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744263.708915:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068441984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.708945:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068441984:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744263.708951:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788744263.708978:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744263.708985:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068442368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.709022:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068442368:12345-0@lo:400:kworker.0 Request processed in 38us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744263.709027:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788744263.709058:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068442368:0@lo:400:kworker.0 00000100:00100000:3.0:1788744263.709068:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068441984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744263.709224:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068442112:0@lo:400:kworker.0 00000100:00100000:1.0:1788744263.709303:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442240 00000100:00100000:1.0:1788744263.709308:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442240 00000100:00100000:1.0:1788744263.709347:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744263.709355:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068442240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744263.709395:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068442240:12345-0@lo:400:kworker.0 Request processed in 42us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744263.709411:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788744263.709433:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068441856 00000100:00100000:1.0:1788744263.709437:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068441856 00000100:00100000:1.0:1788744263.709461:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788744263.709467:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744263.709504:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068441856:12345-0@lo:400:kworker.0 Request processed in 37us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744263.709510:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:1.0:1788744263.709568:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744263.709572:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744263.709588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068441856:0@lo:400:kworker.0 00010000:00080000:3.0:1788744263.709748:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace378700 x1875634068442240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744263.709759:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068442240:0@lo:400:kworker.0 00010000:00010000:2.0:1788744264.410756:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744264.731855:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744264.731888:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068442496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744264.731994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744264.732157:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442496 00000100:00100000:2.0:1788744264.732168:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442496 00000100:00100000:2.0:1788744264.732228:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788744264.732239:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068442496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744264.732278:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744264.732340:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068442496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744264.732348:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788744264.734224:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace379880 x1875634068442496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744264.734253:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068442496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744265.195486:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744265.198588:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744265.198637:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744265.198692:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433856 00000100:00100000:3.0:1788744265.198706:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433856 00000100:00100000:3.0:1788744265.198782:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433728 00000100:00100000:3.0:1788744265.198786:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433728 00000100:00100000:3.0:1788744265.198814:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:3.0:1788744265.198825:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047433856:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744265.198915:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047433856:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 91us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744265.198923:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:3.0:1788744265.198945:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 103 00000100:00100000:3.0:1788744265.198953:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047433728:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744265.198993:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047433728:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744265.198999:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 103 00000100:00080000:3.0:1788744265.199018:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744265.205942:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433600 00000100:00100000:1.0:1788744265.205960:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433600 00000100:00100000:1.0:1788744265.206037:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 237 00000100:00100000:1.0:1788744265.206048:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047433600:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744265.206137:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047433600:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 91us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744265.206144:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 237 00010000:00010000:2.0:1788744265.436646:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744266.459590:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788744266.891678:0:11165:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffeff9a680 20000000:00000080:1.0:1788744266.891699:0:11165:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940b004f9800 uarg=0000000000000000 20000000:01000000:1.0:1788744266.891737:0:11165:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744266.891743:0:11165:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788744266.891747:0:11165:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788744266.892982:0:11166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788744266.893507:0:11165:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788744266.901614:0:11165:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788744266.901648:0:11165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901686:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901695:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901702:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901709:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901716:0:11165:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901723:0:11165:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901770:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901787:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.901802:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442624:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744266.901929:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.901951:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 18 pid: 5830 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.901966:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442752:0@lo:104: 00000100:00100000:1.0:1788744266.902011:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744266.902053:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.902061:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.902069:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442880:0@lo:104: 00000100:00100000:1.0:1788744266.902112:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.902143:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442752 00000100:00100000:1.0:1788744266.902151:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442752 00000100:00100000:1.0:1788744266.902204:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068442880 00000100:00100000:1.0:1788744266.902208:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068442880 00000100:00100000:1.0:1788744266.902223:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744266.902231:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:11165:x1875634068442752:12345-0@lo:104: 00010000:00010000:1.0:1788744266.902244:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744266.902329:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788744266.902339:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:11165:x1875634068442880:12345-0@lo:104: 00010000:00010000:0.0:1788744266.902348:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.903016:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744266.903024:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:11165:x1875634068442880:12345-0@lo:104: Request processed in 687us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.903031:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788744266.903439:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744266.903449:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.903458:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744266.903462:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.903472:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744266.903478:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744266.903494:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744266.903544:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.903573:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744266.903598:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.903604:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164f200/0x7cd2bfd5e1b946b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946bd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.903617:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744266.903619:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744266.903621:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744266.903634:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068443008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744266.903678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744266.904466:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788744266.904475:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:11165:x1875634068442752:12345-0@lo:104: Request processed in 2244us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.904484:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1788744266.904545:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.904586:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 18 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.904613:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068443136:0@lo:104: 00000100:00100000:1.0:1788744266.904648:0:11165:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744266.904680:0:11165:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.904690:0:11165:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 12 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.904699:0:11165:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068443264:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744266.904743:0:11165:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744266.904771:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442752:0@lo:104: 00000100:00100000:1.0:1788744266.904781:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442880:0@lo:104: 00010000:00010000:0.0:1788744266.904847:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744266.904854:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.904862:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744266.904867:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.904876:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744266.904883:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744266.904889:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744266.904919:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.904925:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744266.904951:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.904958:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7297200/0x7cd2bfd5e1b946c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946cb expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.904979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744266.904981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744266.904983:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744266.905784:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068443392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744266.905831:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744266.905920:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443008 00000100:00100000:1.0:1788744266.905942:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443008 00010000:00010000:1.0:1788744266.905974:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 19 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.906007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443392 00000100:00100000:1.0:1788744266.906011:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443392 00010000:00010000:1.0:1788744266.906022:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 20 pid: 5830 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.906039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744266.906048:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3312:x1875634068443008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744266.906061:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744266.906066:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 20 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744266.906408:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744266.906419:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3313:x1875634068443392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744266.906427:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744266.906432:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 20 pid: 5830 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744266.906443:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 20 pid: 5830 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744266.906470:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc800/0x7cd2bfd5e1b946cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946c4 expref: 20 pid: 5830 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744266.906485:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744266.906525:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068443392:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744266.906532:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788744266.906595:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068443392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744266.906719:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443136 00000100:00100000:2.0:1788744266.906724:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443136 00000100:00100000:2.0:1788744266.906758:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788744266.906766:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:11165:x1875634068443136:12345-0@lo:104: 00010000:00010000:2.0:1788744266.906777:0:8446:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906831:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744266.906836:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:11165:x1875634068443136:12345-0@lo:104: Request processed in 72us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744266.906842:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788744266.906862:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744266.906872:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906879:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744266.906883:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906891:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744266.906898:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744266.906904:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744266.906931:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906949:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744266.906968:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906974:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7389400/0x7cd2bfd5e1b946a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b946af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.906988:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744266.906990:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744266.906992:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744266.907001:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068443520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744266.907030:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788744266.907397:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.907409:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b946bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946b6 expref: 18 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.907419:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744266.907462:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3312:x1875634068443008:12345-0@lo:103:ldlm_bl.0 Request processed in 1415us (3783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.907469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744266.907506:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443520 00000100:00100000:1.0:1788744266.907510:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443520 00010000:00010000:1.0:1788744266.907522:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 17 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.907541:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744266.907564:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3310:x1875634068443520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744266.907574:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744266.907578:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 17 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.907587:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 17 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744266.907595:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744266.907623:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3310:x1875634068443520:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744266.907629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744266.907886:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068443520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744266.908022:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b946af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b946a8 expref: 16 pid: 5828 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744266.908034:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068443136:0@lo:104: 00000100:00100000:0.0:1788744266.908385:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068443008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744266.911781:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068442624:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744266.911798:0:11165:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11165:1875634068443264:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744266.911836:0:11165:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744266.914522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744266.914709:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434112 00000100:00100000:2.0:1788744266.914720:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434112 00010000:00010000:2.0:1788744266.914759:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 13 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744266.914801:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:2.0:1788744266.914811:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047434112:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744266.914828:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744266.914834:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 13 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.914845:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 13 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.914865:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164f000/0x7cd2bfd5e1b946a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610be expref: 13 pid: 5828 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.914880:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744266.917463:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2353:x1875634047434112:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 2640us (2939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744266.917480:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:1.0:1788744266.917677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744266.917791:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047433984 00000100:00100000:0.0:1788744266.917801:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047433984 00010000:00010000:0.0:1788744266.917835:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744266.917869:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:0.0:1788744266.917876:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2353:x1875634047433984:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744266.917889:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744266.917894:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917906:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917922:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7388a00/0x7cd2bfd5e1b946e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610f6 expref: 12 pid: 5830 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917952:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917961:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917990:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.917998:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918004:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918011:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918017:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744266.918021:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918029:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918044:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744266.918053:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744266.918630:0:11165:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.918642:0:11165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744266.918648:0:11165:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b946fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744266.919818:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2353:x1875634047433984:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 1930us (2130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744266.919831:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 29 00010000:00010000:2.0:1788744267.484707:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788744268.253156:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788744268.253163:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940b004f2800 from 7 10000000:01000000:2.0:1788744268.253168:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744268.253225:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.253238:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.253249:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744268.253273:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788744268.253339:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744268.253397:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744268.254030:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443648 00000100:00100000:3.0:1788744268.254039:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443648 00000100:00100000:3.0:1788744268.254115:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788744268.254126:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068443648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744268.254142:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744268.254161:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94703 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.254188:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.254197:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.254205:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744268.254267:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068443648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.254274:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788744268.255667:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744268.255694:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.255706:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744268.255788:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744268.255842:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744268.255900:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744268.256595:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443776 00000100:00100000:3.0:1788744268.256603:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443776 00000100:00100000:3.0:1788744268.256647:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788744268.256656:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068443776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.256953:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068443776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.256961:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788744268.257012:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.257065:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.257109:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744268.257134:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744268.257615:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068443904 00000100:00100000:2.0:1788744268.257622:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068443904 00000100:00100000:2.0:1788744268.257669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788744268.257677:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068443904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744268.257841:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068443904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744268.257848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788744268.258187:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068443904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744268.261173:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788744268.261313:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788744268.261336:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744268.261348:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.261360:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744268.261371:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744268.261375:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940aceda7000 from 7 10000000:01000000:3.0:1788744268.261378:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744268.261416:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.261435:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.261447:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744268.261473:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.261538:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744268.261600:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744268.261678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444032 00000100:00100000:1.0:1788744268.261686:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444032 00000100:00100000:1.0:1788744268.261748:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788744268.261758:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068444032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744268.261772:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744268.261786:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b94711 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744268.261810:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744268.261822:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744268.261829:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2e00, rc 0) 00000100:00100000:1.0:1788744268.261873:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744268.261894:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788744268.261984:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744268.262010:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.262018:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744268.262074:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.262102:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744268.262131:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744268.262173:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444160 00000100:00100000:1.0:1788744268.262178:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444160 00000100:00100000:1.0:1788744268.262212:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788744268.262218:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744268.262445:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744268.262453:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788744268.262713:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.262742:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744268.262783:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744268.262814:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620600 going to sleep for 11 seconds 00000100:00100000:1.0:1788744268.262855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444288 00000100:00100000:1.0:1788744268.262861:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444288 00000100:00100000:1.0:1788744268.262891:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788744268.262899:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744268.263074:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744268.263081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788744268.263266:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceeae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744268.282205:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788744268.282283:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788744268.282305:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744268.282329:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.282343:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744268.282355:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744268.282358:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac7f4d800 from 7 10000000:01000000:0.0:1788744268.282361:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744268.282404:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.282413:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.282425:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744268.282459:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.282530:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.282598:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744268.282881:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444416 00000100:00100000:3.0:1788744268.282895:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444416 00000100:00100000:3.0:1788744268.283016:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788744268.283026:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068444416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744268.283041:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744268.283184:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9471f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.283212:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.283223:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744268.283233:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fce00, rc 0) 00000100:00100000:3.0:1788744268.283285:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068444416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744268.283292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788744268.283362:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744268.283376:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.283384:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744268.283436:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.283475:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.289322:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744268.289412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444544 00000100:00100000:1.0:1788744268.289423:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444544 00000100:00100000:1.0:1788744268.289474:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788744268.289482:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068444544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744268.289780:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068444544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744268.289788:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788744268.291227:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.291290:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.291359:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.291405:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744268.291427:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444672 00000100:00100000:0.0:1788744268.291432:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444672 00000100:00100000:0.0:1788744268.291466:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788744268.291474:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068444672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.291677:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068444672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.291685:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788744268.291729:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068444672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744268.293320:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788744268.293578:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788744268.293600:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744268.293611:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744268.293622:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744268.391780:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744268.391894:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434240 00000100:00100000:0.0:1788744268.391915:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434240 00000100:00100000:0.0:1788744268.391972:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 247 00000100:00100000:0.0:1788744268.391982:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:5595:x1875634047434240:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744268.391999:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744268.392019:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761120 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.392052:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.392080:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744268.392090:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296800, rc 0) 00000100:00100000:0.0:1788744268.392155:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434240:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 174us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.392162:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 247 00000100:00100000:2.0:1788744268.400970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744268.403333:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434368 00000100:00100000:3.0:1788744268.403350:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434368 00000100:00100000:0.0:1788744268.405536:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 248 00000100:00100000:0.0:1788744268.405580:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434368:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.406257:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434368:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 703us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.406266:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 248 00000100:00100000:3.0:1788744268.408850:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744268.409005:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434496 00000100:00100000:0.0:1788744268.409017:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434496 00000100:00100000:0.0:1788744268.409148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 249 00000100:00100000:0.0:1788744268.409159:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434496:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.409515:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434496:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 356us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.409524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 249 00000100:00100000:0.0:1788744268.423170:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744268.423316:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434624 00000100:00100000:2.0:1788744268.423327:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434624 00000100:00100000:2.0:1788744268.423378:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 250 00000100:00100000:2.0:1788744268.423389:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047434624:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744268.423407:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744268.423427:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761127 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.423461:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.423474:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744268.423485:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389a00, rc 0) 00000100:00100000:2.0:1788744268.423543:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047434624:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 156us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744268.423654:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 250 00000100:00100000:3.0:1788744268.429336:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744268.429427:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434752 00000100:00100000:0.0:1788744268.429441:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434752 00000100:00100000:0.0:1788744268.429501:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 251 00000100:00100000:0.0:1788744268.429513:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047434752:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744268.429919:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047434752:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 407us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.429929:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 251 00000100:00100000:3.0:1788744268.437822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744268.437944:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047434880 00000100:00100000:2.0:1788744268.437954:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047434880 00000100:00100000:2.0:1788744268.438022:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 252 00000100:00100000:2.0:1788744268.438035:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047434880:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744268.440440:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047434880:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 2395us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744268.440457:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 252 00010000:00010000:2.0:1788744268.506775:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744268.826702:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744268.826725:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744268.826814:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.826894:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444800 00000100:00100000:0.0:1788744268.826916:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444800 00000100:00100000:0.0:1788744268.826986:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744268.826996:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068444800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744268.827035:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744268.827080:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068444800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.827088:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788744268.827109:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788744268.827140:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6e680 x1875634068444800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744268.827160:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068444800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744268.831413:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068444928:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.831502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.831579:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744268.831587:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.831637:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.831690:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.831715:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.831759:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744268.831766:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.831807:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744268.831839:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068444928 00000100:00100000:0.0:1788744268.831848:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068444928 00000100:00100000:0.0:1788744268.831888:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445056 00000100:00100000:0.0:1788744268.831892:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445056 00000100:00100000:0.0:1788744268.831933:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445312 00000100:00100000:0.0:1788744268.831936:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445312 00000100:00100000:0.0:1788744268.831956:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744268.831965:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068444928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832015:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068444928:12345-0@lo:400:kworker.0 Request processed in 51us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.832022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788744268.832040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788744268.832046:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068445056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832073:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068445056:12345-0@lo:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.832079:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788744268.832090:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744268.832096:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068445312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832124:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068445312:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.832130:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744268.832156:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445184 00000100:00100000:0.0:1788744268.832159:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445184 00000100:00100000:0.0:1788744268.832185:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744268.832192:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068445184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832231:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068445184:12345-0@lo:400:kworker.0 Request processed in 40us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744268.832237:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788744268.832277:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744268.832281:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744268.832304:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940affa6f480 x1875634068445184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744268.832317:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068445184:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832329:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068445312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832364:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068445056:0@lo:400:kworker.0 00000100:00100000:0.0:1788744268.832373:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068444928:0@lo:400:kworker.0 00010000:00010000:2.0:1788744269.540767:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744269.860318:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744269.860424:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744269.860607:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445440 00000100:00100000:2.0:1788744269.860617:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445440 00000100:00100000:2.0:1788744269.860673:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788744269.860683:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068445440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744269.860730:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744269.860783:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068445440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744269.860790:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788744269.860891:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace378a80 x1875634068445440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744269.860912:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068445440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744270.328242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744270.328376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744270.328425:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435008 00000100:00100000:3.0:1788744270.328439:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435008 00000100:00100000:3.0:1788744270.328501:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 253 00000100:00100000:3.0:1788744270.328513:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047435008:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744270.328680:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047435008:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 168us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744270.328705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 253 00000100:00100000:3.0:1788744270.331097:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744270.334190:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435264 00000100:00100000:1.0:1788744270.334219:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435264 00000100:00100000:1.0:1788744270.334303:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435136 00000100:00100000:1.0:1788744270.334306:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435136 00000100:00100000:1.0:1788744270.334340:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 107 00000100:00100000:1.0:1788744270.334352:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047435264:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744270.334442:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047435264:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 92us (6212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744270.334450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 107 00000100:00100000:1.0:1788744270.334469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 108 00000100:00100000:1.0:1788744270.334476:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047435136:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744270.334499:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047435136:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744270.334505:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 108 00000100:00080000:3.0:1788744270.335278:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744270.562270:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744271.231710:0:11363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744271.581678:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744272.602852:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744273.630121:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744273.951667:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068445568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744273.951750:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.952708:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068445696:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.952769:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.952824:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068446208:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.952858:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.952887:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744273.952894:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.952922:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.952966:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446208 00000100:00100000:1.0:1788744273.952977:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446208 00000100:00100000:1.0:1788744273.953047:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445824 00000100:00100000:1.0:1788744273.953051:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445824 00000100:00100000:1.0:1788744273.953077:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744273.953088:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068446208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953177:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068446208:12345-0@lo:400:kworker.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.953186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744273.953207:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744273.953215:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953243:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068445824:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.953249:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788744273.953274:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744273.953297:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068445952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953325:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.953348:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744273.953354:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068446080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744273.953407:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445952 00000100:00100000:1.0:1788744273.953410:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445952 00000100:00100000:1.0:1788744273.953437:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788744273.953443:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068445952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953476:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068445952:12345-0@lo:400:kworker.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.953482:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788744273.953497:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446080 00000100:00100000:1.0:1788744273.953501:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446080 00000100:00100000:1.0:1788744273.953526:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788744273.953532:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068446080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953584:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068446080:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744273.953596:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788744273.953614:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744273.953617:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788744273.953643:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa6f2a00 x1875634068446080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744273.953657:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068446080:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953669:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068445952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953703:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068445824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744273.953713:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068446208:0@lo:400:kworker.0 00000100:00100000:2.0:1788744273.955723:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445568 00000100:00100000:2.0:1788744273.955739:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445568 00000100:00100000:2.0:1788744273.955831:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744273.955843:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068445568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744273.955881:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744273.955959:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068445568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (4210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.955966:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788744273.955990:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068445696 00000100:00100000:2.0:1788744273.955994:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068445696 00000100:00100000:2.0:1788744273.956018:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788744273.956039:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068445696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744273.956079:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1daf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068445696:12345-0@lo:400:kworker.0 Request processed in 42us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744273.956085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:2.0:1788744273.956122:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788744273.956156:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940b00ba2680 x1875634068445568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744273.956178:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068445568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744273.956211:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068445696:0@lo:400:kworker.0 00010000:00010000:2.0:1788744274.651290:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744274.973044:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744274.973079:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068446336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744274.973182:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744274.973371:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446336 00000100:00100000:2.0:1788744274.973382:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446336 00000100:00100000:2.0:1788744274.973453:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788744274.973473:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068446336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744274.973527:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744274.973628:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068446336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744274.973637:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788744274.973689:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace378a80 x1875634068446336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744274.973713:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068446336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744275.432018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744275.432172:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435392 00000100:00100000:0.0:1788744275.432188:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435392 00000100:00100000:0.0:1788744275.432263:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 255 00000100:00100000:0.0:1788744275.432277:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047435392:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744275.439251:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1dac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047435392:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 6956us (7233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744275.439273:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 255 00000100:00100000:3.0:1788744275.439498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744275.440425:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744275.460214:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435648 00000100:00100000:0.0:1788744275.460240:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435648 00000100:00100000:3.0:1788744275.460446:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435520 00000100:00100000:3.0:1788744275.460453:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435520 00000100:00100000:3.0:1788744275.460516:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 112 00000100:00100000:3.0:1788744275.460530:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047435520:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744275.460691:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047435520:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 163us (20270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744275.460700:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 112 00000100:00100000:1.0:1788744275.461299:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 113 00000100:00100000:1.0:1788744275.461311:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047435648:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744275.461356:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047435648:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 49us (21861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744275.461363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 113 00000100:00080000:0.0:1788744275.461498:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788744275.648762:0:11464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:24:33 (1788744273) === 00010000:00010000:1.0:1788744275.676625:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744275.989708:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744275.992006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744275.992110:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435776 00000100:00100000:1.0:1788744275.992122:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435776 00000100:00100000:1.0:1788744275.992192:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:1.0:1788744275.992337:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047435776:12345-192.168.204.56@tcp:41:mkdir.0 00000004:00000024:1.0:1788744275.992386:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788744275.992489:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047435776:12345-192.168.204.56@tcp:41:mkdir.0 Request processed in 154us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744275.992497:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:2.0:1788744275.995712:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047435904 00000100:00100000:2.0:1788744275.995731:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047435904 00000100:00100000:2.0:1788744275.995846:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:2.0:1788744275.995867:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03c88f08-96bd-4666-9af8-74d11f561443+6:9687:x1875634047435904:12345-192.168.204.56@tcp:700:mkdir.0 00000100:00100000:2.0:1788744275.995992:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03c88f08-96bd-4666-9af8-74d11f561443+6:9687:x1875634047435904:12345-192.168.204.56@tcp:700:mkdir.0 Request processed in 127us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744275.996001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:1.0:1788744276.005287:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744276.005368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047436160 00000100:00100000:3.0:1788744276.005380:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047436160 00000100:00100000:3.0:1788744276.005443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:3.0:1788744276.005453:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:9687:x1875634047436160:12345-192.168.204.56@tcp:36:mkdir.0 00010000:00010000:3.0:1788744276.005513:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744276.005540:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b9461c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610a9 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.005580:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:3.0:1788744276.005592:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744276.005948:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.005962:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.005979:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.006157:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.006166:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.006174:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744276.010988:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788744276.011012:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011022:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011044:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011051:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.011056:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011065:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:3.0:1788744276.011085:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.011106:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.011113:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9473b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744276.011138:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001dc68bef reply state 00000000b4552240 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744276.011149:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744276.011290:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:9687:x1875634047436160:12345-192.168.204.56@tcp:36:mkdir.0 Request processed in 5831us (6008us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788744276.011301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00010000:00010000:0.0:1788744276.013608:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013624:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013631:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013638:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744276.013642:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013651:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013666:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff940ad8818200) 00010000:00010000:0.0:1788744276.013669:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744276.013674:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.013680:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94742 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.033457:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.036033:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047436288 00000100:00100000:2.0:1788744276.036067:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047436288 00000100:00100000:2.0:1788744276.036167:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:2.0:1788744276.036179:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:9688:x1875634047436288:12345-192.168.204.56@tcp:101:chmod.0 00010000:00010000:2.0:1788744276.036204:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744276.036229:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b94749 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576112e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036295:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036310:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036324:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744276.036363:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744276.036367:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744276.036407:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036431:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b94749 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576112e expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036452:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576112e expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.036473:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744276.036476:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744276.036480:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389400, rc 0) 00000100:00100000:2.0:1788744276.036606:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:9688:x1875634047436288:12345-192.168.204.56@tcp:101:chmod.0 Request processed in 429us (3160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.036614:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:1.0:1788744276.041141:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.041348:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047436544 00000100:00100000:0.0:1788744276.041374:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047436544 00000100:00100000:0.0:1788744276.041442:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:0.0:1788744276.041454:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+7:9688:x1875634047436544:12345-192.168.204.56@tcp:36:chmod.0 00010000:00010000:0.0:1788744276.041519:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744276.041546:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94750 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576112e expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.041597:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:0.0:1788744276.041609:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744276.041638:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.041651:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.041660:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744276.042668:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b79f88f3 reply state 0000000090b437b5 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744276.042684:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788744276.042696:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788744276.042886:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+8:9688:x1875634047436544:12345-192.168.204.56@tcp:36:chmod.0 Request processed in 1431us (1755us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788744276.042895:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00010000:00010000:3.0:1788744276.052880:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052913:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052923:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052930:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.052936:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052944:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052965:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad90af000) 00010000:00010000:3.0:1788744276.052968:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744276.052975:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.052997:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94757 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.094622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744276.094814:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047436672 00000100:00100000:3.0:1788744276.094824:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047436672 00000100:00100000:3.0:1788744276.094893:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:3.0:1788744276.094905:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:9689:x1875634047436672:12345-192.168.204.56@tcp:101:chown.0 00010000:00010000:3.0:1788744276.094938:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744276.094966:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9475e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761135 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095032:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095060:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744276.095099:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744276.095102:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744276.095139:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095163:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9475e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761135 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095185:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761135 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.095207:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:3.0:1788744276.095211:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744276.095214:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f000, rc 0) 00000100:00100000:3.0:1788744276.095276:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:9689:x1875634047436672:12345-192.168.204.56@tcp:101:chown.0 Request processed in 373us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.095283:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:0.0:1788744276.103682:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.103790:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047436800 00000100:00100000:2.0:1788744276.103800:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047436800 00000100:00100000:2.0:1788744276.103866:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:2.0:1788744276.103877:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:9689:x1875634047436800:12345-192.168.204.56@tcp:101:chown.0 00010000:00010000:2.0:1788744276.103899:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744276.103922:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9476c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576113c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.103988:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104002:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104012:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104028:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104165:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104194:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104289:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104297:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104304:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744276.104338:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744276.104341:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744276.104364:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104377:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104383:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104390:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104396:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744276.104400:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104408:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104428:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:2.0:1788744276.104431:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744276.104437:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104443:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104460:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104467:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104473:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104479:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744276.104481:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104487:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104494:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff940ac2bbc600) 00010000:00010000:2.0:1788744276.104496:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744276.104499:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104504:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b9477a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104614:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9476c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576113c expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104629:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576113c expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.104637:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744276.104639:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744276.104641:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389800, rc 0) 00000100:00100000:2.0:1788744276.104714:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+9:9689:x1875634047436800:12345-192.168.204.56@tcp:101:chown.0 Request processed in 838us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.104721:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:2.0:1788744276.132753:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.132947:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437056 00000100:00100000:0.0:1788744276.132959:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437056 00000100:00100000:0.0:1788744276.133023:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:0.0:1788744276.133048:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+9:9689:x1875634047437056:12345-192.168.204.56@tcp:36:chown.0 00010000:00010000:0.0:1788744276.133108:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744276.133135:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576113c expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.133159:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:0.0:1788744276.133170:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744276.133199:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.133211:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.133221:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744276.183110:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000013fecfa3 reply state 00000000d9c58046 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.183129:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788744276.183143:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788744276.183253:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+10:9689:x1875634047437056:12345-192.168.204.56@tcp:36:chown.0 Request processed in 50202us (50509us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788744276.183263:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00010000:00010000:0.0:1788744276.195438:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195459:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195468:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195475:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744276.195481:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195490:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195531:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad90af100) 00010000:00010000:0.0:1788744276.195534:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744276.195540:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.195561:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744276.197870:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000100:00100000:2.0:1788744276.206835:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744276.206958:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437184 00000100:00100000:1.0:1788744276.206968:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437184 00000100:00100000:1.0:1788744276.207034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:1.0:1788744276.207046:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:9690:x1875634047437184:12345-192.168.204.56@tcp:101:touch.500 00010000:00010000:1.0:1788744276.207074:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744276.207101:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b9478f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761143 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744276.210778:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3621us 00010000:00010000:3.0:1788744276.259135:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259158:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259170:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259189:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259197:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259204:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259593:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259603:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259616:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744276.259642:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744276.259646:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744276.259684:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259697:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259704:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259711:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259718:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.259721:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259729:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259743:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:3.0:1788744276.259747:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.259751:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259770:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259794:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259801:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259806:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259812:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.259814:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259820:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259828:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff940ad8818e00) 00010000:00010000:3.0:1788744276.259830:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.259833:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259838:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b9479d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.259885:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b9478f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761143 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.261254:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761143 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.261297:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:3.0:1788744276.261301:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788744276.261305:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fde00, rc 0) 00000100:00100000:3.0:1788744276.261397:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:9690:x1875634047437184:12345-192.168.204.56@tcp:101:touch.500 Request processed in 54349us (54567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.261408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:1.0:1788744276.267280:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.267503:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437440 00000100:00100000:2.0:1788744276.267514:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437440 00000100:00100000:2.0:1788744276.267615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:2.0:1788744276.267628:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:9690:x1875634047437440:12345-192.168.204.56@tcp:101:touch.500 00010000:00010000:2.0:1788744276.267654:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744276.267678:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b947ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576114a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.267971:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.267987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.268010:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.268074:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.268084:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.268092:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744276.268922:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788744276.269219:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b947c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269232:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b947c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269243:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b947c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269287:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269295:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269304:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269310:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744276.269323:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269331:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269347:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:2.0:1788744276.269351:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744276.269358:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269365:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b947b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744276.269381:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000786ac0ee reply state 00000000e5e58a3c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744276.269390:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744276.269430:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b947ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576114a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269447:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b947c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576114a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.269455:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ac2bbc600) 00010000:00010000:2.0:1788744276.269458:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744276.269461:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389000, rc 0) 00000100:00100000:2.0:1788744276.269597:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+10:9690:x1875634047437440:12345-192.168.204.56@tcp:101:touch.500 Request processed in 1970us (2326us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788744276.269605:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 22 00010000:00010000:1.0:1788744276.272912:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272929:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272937:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272943:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744276.272948:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272955:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272972:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff940ac2bbcf00) 00010000:00010000:1.0:1788744276.272976:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744276.272980:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.272987:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b947b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.280063:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.280307:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437696 00000100:00100000:0.0:1788744276.280320:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437696 00000100:00100000:0.0:1788744276.280389:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:0.0:1788744276.280400:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+9:9690:x1875634047437696:12345-192.168.204.56@tcp:36:touch.500 00010000:00010000:0.0:1788744276.280466:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744276.280496:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b947c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576114a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.280518:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ac2bbc600) 00010000:00010000:0.0:1788744276.280529:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744276.280606:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.280619:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.280629:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744276.280788:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000069a4fd11 reply state 0000000074dc8a9a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744276.280822:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744276.281067:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+10:9690:x1875634047437696:12345-192.168.204.56@tcp:36:touch.500 Request processed in 668us (1018us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788744276.281075:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 23 00010000:00010000:0.0:1788744276.283064:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283080:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283088:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283094:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744276.283100:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283108:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283124:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad90af100) 00010000:00010000:0.0:1788744276.283128:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744276.283132:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.283139:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.284718:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744276.285003:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437824 00000100:00100000:3.0:1788744276.285015:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437824 00000100:00100000:3.0:1788744276.285083:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:3.0:1788744276.285094:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:9690:x1875634047437824:12345-192.168.204.56@tcp:101:touch.500 00010000:00010000:3.0:1788744276.285121:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744276.285153:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b947d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761151 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.285226:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b947d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761151 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.285240:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b947d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761151 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.285263:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:3.0:1788744276.285267:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744276.285270:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc200, rc 0) 00000100:00100000:3.0:1788744276.285351:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+10:9690:x1875634047437824:12345-192.168.204.56@tcp:101:touch.500 Request processed in 258us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.285372:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:3.0:1788744276.298287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744276.298394:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047437952 00000100:00100000:1.0:1788744276.298407:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047437952 00000100:00100000:1.0:1788744276.298476:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:1.0:1788744276.298488:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875634047437952:12345-192.168.204.56@tcp:8:touch.500 00010000:00080000:1.0:1788744276.298534:0:6682:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:1.0:1788744276.298639:0:6682:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b947dc 00002000:00100000:1.0:1788744276.298660:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03c88f08-96bd-4666-9af8-74d11f561443/ffff940ad0c18800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744276.298674:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788744276.299013:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788744276.299049:0:6682:0:(import.c:65:import_set_state_nolock()) ffff940ad0c1a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744276.299114:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047437952:12345-192.168.204.56@tcp:8:touch.500 Request processed in 626us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744276.299122:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:1.0:1788744276.312740:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.312857:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047438080 00000100:00100000:2.0:1788744276.312868:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047438080 00000100:00100000:2.0:1788744276.312948:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:2.0:1788744276.312958:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:0:x1875634047438080:12345-192.168.204.56@tcp:2:touch.500 00000100:00080000:0.0:1788744276.313459:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788744276.384298:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000001:00080000:0.0:1788744276.384333:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788744276.384532:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:0:x1875634047438080:12345-192.168.204.56@tcp:2:touch.500 Request processed in 71570us (71795us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788744276.384543:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:3.0:1788744276.388073:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.388422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047438336 00000100:00100000:2.0:1788744276.388438:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047438336 00000100:00100000:2.0:1788744276.388507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744276.388519:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+10:9690:x1875634047438336:12345-192.168.204.56@tcp:35:touch.500 00000100:00100000:2.0:1788744276.389067:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+11:9690:x1875634047438336:12345-192.168.204.56@tcp:35:touch.500 Request processed in 547us (1003us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744276.389076:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:0.0:1788744276.409111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744276.409308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047438464 00000100:00100000:3.0:1788744276.409320:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047438464 00000100:00100000:3.0:1788744276.409389:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:3.0:1788744276.409400:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+11:9691:x1875634047438464:12345-192.168.204.56@tcp:101:rm.0 00010000:00010000:3.0:1788744276.409427:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744276.409450:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b947e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761158 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409523:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409539:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409593:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744276.409631:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744276.409634:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744276.409671:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409697:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b947e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761158 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409733:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761158 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.409770:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:3.0:1788744276.409773:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744276.409778:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164ee00, rc 0) 00000100:00100000:3.0:1788744276.409850:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+12:9691:x1875634047438464:12345-192.168.204.56@tcp:101:rm.0 Request processed in 452us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744276.409858:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:1.0:1788744276.418966:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.419115:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047438720 00000100:00100000:0.0:1788744276.419129:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047438720 00000100:00100000:0.0:1788744276.419207:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:0.0:1788744276.419218:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+12:9691:x1875634047438720:12345-192.168.204.56@tcp:101:rm.0 00010000:00010000:0.0:1788744276.419241:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744276.419270:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576115f expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744276.419387:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788744276.419530:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576115f expref: 14 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.419544:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:0.0:1788744276.419593:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744276.419600:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b947f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576115f expref: 14 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.419613:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297000, rc 0) 00000100:00100000:0.0:1788744276.419673:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+13:9691:x1875634047438720:12345-192.168.204.56@tcp:101:rm.0 Request processed in 458us (724us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788744276.419681:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:3.0:1788744276.425621:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.425776:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047438848 00000100:00100000:2.0:1788744276.425787:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047438848 00000100:00100000:2.0:1788744276.425858:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:2.0:1788744276.425872:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:9691:x1875634047438848:12345-192.168.204.56@tcp:37:rm.0 00000100:00100000:2.0:1788744276.432535:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:9691:x1875634047438848:12345-192.168.204.56@tcp:37:rm.0 Request processed in 6649us (6908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.432580:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:3.0:1788744276.436466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.436988:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047439104 00000100:00100000:0.0:1788744276.436999:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047439104 00000100:00100000:0.0:1788744276.437088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:0.0:1788744276.437100:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad86db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:9691:x1875634047439104:12345-192.168.204.56@tcp:35:rm.0 00000100:00100000:0.0:1788744276.437409:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad86db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:9691:x1875634047439104:12345-192.168.204.56@tcp:35:rm.0 Request processed in 311us (955us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788744276.437418:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:1.0:1788744276.440581:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.440696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047439360 00000100:00100000:2.0:1788744276.440708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047439360 00000100:00100000:2.0:1788744276.440793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:2.0:1788744276.440804:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:9691:x1875634047439360:12345-192.168.204.56@tcp:101:rm.0 00010000:00010000:2.0:1788744276.440833:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744276.440873:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b947ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761166 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.440984:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94806 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.440999:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.441011:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744276.441022:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788744276.441186:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b947ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761166 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.441204:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761166 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.441211:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:2.0:1788744276.441214:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744276.441218:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744276.441288:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047439360:12345-192.168.204.56@tcp:101:rm.0 Request processed in 485us (744us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788744276.441295:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:1.0:1788744276.445886:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.446256:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047439488 00000100:00100000:2.0:1788744276.446266:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047439488 00000100:00100000:2.0:1788744276.446360:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:2.0:1788744276.446370:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047439488:12345-192.168.204.56@tcp:41:rm.0 00000004:00000024:2.0:1788744276.446444:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788744276.446511:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047439488:12345-192.168.204.56@tcp:41:rm.0 Request processed in 142us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744276.446518:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:3.0:1788744276.449016:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.449813:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047439616 00000100:00100000:0.0:1788744276.449826:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047439616 00000100:00100000:0.0:1788744276.450040:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:0.0:1788744276.450052:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047439616:12345-192.168.204.56@tcp:101:rm.0 00010000:00010000:0.0:1788744276.450074:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744276.450094:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576116d expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450159:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450174:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450186:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450200:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450207:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450214:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450311:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450332:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450339:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744276.450368:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788744276.450372:0:10823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744276.450389:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450400:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450408:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450415:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450422:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450429:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744276.450433:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450440:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450453:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:0.0:1788744276.450461:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744276.450466:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450473:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297800/0x7cd2bfd5e1b9481b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450489:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450495:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450501:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450507:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744276.450510:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450516:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450523:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff940ad90af600) 00010000:00010000:0.0:1788744276.450525:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744276.450528:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450534:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450614:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576116d expref: 18 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450641:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576116d expref: 17 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.450649:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:0.0:1788744276.450651:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744276.450654:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297200, rc 0) 00000100:00100000:0.0:1788744276.450728:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+17:9691:x1875634047439616:12345-192.168.204.56@tcp:101:rm.0 Request processed in 678us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744276.450736:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:1.0:1788744276.454509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744276.455833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047439872 00000100:00100000:3.0:1788744276.455855:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047439872 00000100:00100000:3.0:1788744276.455944:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:3.0:1788744276.455956:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+17:9691:x1875634047439872:12345-192.168.204.56@tcp:36:rm.0 00010000:00010000:3.0:1788744276.456013:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744276.456042:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576116d expref: 17 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456067:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b947d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761151 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456080:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:3.0:1788744276.456097:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b947ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761158 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456107:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:3.0:1788744276.456124:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744276.456147:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456160:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456170:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456186:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456193:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456201:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456350:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456359:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.456366:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744276.457135:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788744276.457147:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348589597155ns, next at 349589594482ns, rc = 0 00010000:00010000:3.0:1788744276.457211:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457233:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457243:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457252:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457258:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457263:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457282:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744276.457302:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457308:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457314:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457320:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.457324:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457331:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457353:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad8818000) 00010000:00010000:3.0:1788744276.457355:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788744276.457360:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457365:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031600/0x7cd2bfd5e1b9483e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457382:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457388:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457392:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457397:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.457400:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457405:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:3.0:1788744276.457414:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.457416:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.457422:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94830 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744276.457443:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e4ff7617 reply state 00000000f9c6bbfc transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744276.457451:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744276.457578:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047439872:12345-192.168.204.56@tcp:36:rm.0 Request processed in 1595us (3050us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788744276.457587:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00010000:00010000:2.0:1788744276.457849:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744276.457856:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.457862:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744276.457865:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.457872:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.457880:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff940ad8818000) 00010000:00010000:2.0:1788744276.457883:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788744276.457885:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.457890:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744276.457906:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744276.457907:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744276.457909:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744276.461161:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461179:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461187:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461193:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.461197:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461204:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461222:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff940ad8818200) 00010000:00010000:3.0:1788744276.461225:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.461229:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.461236:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b94837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.462674:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744276.462839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440128 00000100:00100000:2.0:1788744276.462850:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440128 00000100:00100000:2.0:1788744276.462925:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:2.0:1788744276.462937:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+15:9691:x1875634047440128:12345-192.168.204.56@tcp:35:rm.0 00000100:00100000:2.0:1788744276.463190:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047440128:12345-192.168.204.56@tcp:35:rm.0 Request processed in 254us (533us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788744276.463198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:2.0:1788744276.467295:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744276.467429:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440384 00000100:00100000:0.0:1788744276.467440:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440384 00000100:00100000:0.0:1788744276.467544:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:0.0:1788744276.467621:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+16:9691:x1875634047440384:12345-192.168.204.56@tcp:36:rm.0 00010000:00010000:0.0:1788744276.467684:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788744276.467710:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761166 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468415:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b947a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761143 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468429:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ad8818500) 00010000:00010000:0.0:1788744276.468445:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94765 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761135 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468454:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:0.0:1788744276.468475:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744276.468499:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468512:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468522:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468534:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468541:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744276.468626:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.469199:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.469209:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.469217:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744276.470210:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788744276.470237:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470246:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470264:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470272:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744276.470277:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470286:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470301:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff940ac3570200) 00010000:00010000:1.0:1788744276.470304:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788744276.470308:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470315:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b9485a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470341:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470348:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470354:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470359:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744276.470362:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470378:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470387:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad90af600) 00010000:00010000:1.0:1788744276.470389:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744276.470393:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.470399:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9484c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744276.470413:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000173c6cc0 reply state 0000000041530976 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744276.470423:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744276.470532:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+15:9691:x1875634047440384:12345-192.168.204.56@tcp:36:rm.0 Request processed in 2912us (3252us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788744276.470542:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 31 00010000:00010000:3.0:1788744276.478965:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.478985:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.478994:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.479006:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744276.479011:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.479019:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.479038:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff940ad90af100) 00010000:00010000:3.0:1788744276.479042:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744276.479047:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744276.479055:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297a00/0x7cd2bfd5e1b94853 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744276.703072:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744277.725077:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744278.746996:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744279.066779:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068446720:0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.066859:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744279.066921:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744279.066927:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068446848:0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.066949:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744279.066979:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446720 00000100:00100000:1.0:1788744279.066986:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446720 00000100:00100000:1.0:1788744279.067033:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788744279.067054:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068446720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.067113:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068446720:12345-0@lo:400:kworker.0 Request processed in 60us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.067125:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788744279.067148:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446848 00000100:00100000:1.0:1788744279.067151:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446848 00000100:00100000:1.0:1788744279.067174:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744279.067180:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068446848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.067205:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068446848:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.067210:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788744279.067223:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744279.067227:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788744279.067256:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73a8000 x1875634068446848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744279.067269:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068446848:0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.067279:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068446720:0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067478:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068446592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744279.067534:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068447104:0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067571:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744279.067593:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788744279.067599:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068446464:0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067621:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744279.067640:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068446976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067657:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744279.067676:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446464 00000100:00100000:0.0:1788744279.067680:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446464 00000100:00100000:0.0:1788744279.067730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788744279.067737:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068446464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.067773:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068446464:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744279.067779:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788744279.067812:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068446464:0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.068077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446592 00000100:00100000:1.0:1788744279.068082:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446592 00000100:00100000:1.0:1788744279.068263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068446976 00000100:00100000:1.0:1788744279.068268:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068446976 00000100:00080000:3.0:1788744279.068326:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744279.068531:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068447232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744279.068607:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744279.068712:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068447232 00000100:00100000:3.0:1788744279.068717:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068447232 00000100:00100000:3.0:1788744279.068766:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744279.068777:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068447232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744279.068818:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744279.068889:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068447232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744279.068897:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788744279.068945:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa5cdf80 x1875634068447232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744279.068962:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068447232:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788744279.069087:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744279.073460:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788744279.073491:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068446592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.073634:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068446592:12345-0@lo:400:kworker.0 Request processed in 159us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744279.073641:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788744279.073671:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788744279.073679:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068446976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744279.073728:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068446976:12345-0@lo:400:kworker.0 Request processed in 51us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744279.073734:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788744279.073877:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068446976:0@lo:400:kworker.0 00000100:00100000:2.0:1788744279.073893:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068446592:0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.074247:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068447104 00000100:00100000:1.0:1788744279.074255:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068447104 00000100:00100000:1.0:1788744279.075172:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788744279.075187:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068447104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744279.075271:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068447104:12345-0@lo:400:kworker.0 Request processed in 90us (7699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744279.075294:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1788744279.075381:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73a9500 x1875634068447104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744279.075394:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068447104:0@lo:400:kworker.0 00010000:00010000:1.0:1788744279.772996:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788744280.091088:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352223536328ns, next at 353223533296ns, rc = 0 00000100:00100000:3.0:1788744280.091153:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068447360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744280.091231:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744280.091337:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068447360 00000100:00100000:2.0:1788744280.091346:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068447360 00000100:00100000:2.0:1788744280.091411:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788744280.091421:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068447360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744280.091463:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744280.091513:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068447360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744280.091520:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788744280.091592:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ace378700 x1875634068447360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744280.091612:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068447360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744280.553942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744280.553992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744280.554113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440512 00000100:00100000:1.0:1788744280.554124:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440512 00000100:00100000:1.0:1788744280.554182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 257 00000100:00100000:1.0:1788744280.554193:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047440512:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744280.554269:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047440512:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 77us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744280.554278:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 257 00000100:00100000:1.0:1788744280.558181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744280.558238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744280.558421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440640 00000100:00100000:0.0:1788744280.558432:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440640 00000100:00100000:0.0:1788744280.558496:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440896 00000100:00100000:0.0:1788744280.558500:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440896 00000100:00100000:0.0:1788744280.558522:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:0.0:1788744280.558533:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:2351:x1875634047440640:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744280.558654:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:2351:x1875634047440640:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 123us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744280.558662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:0.0:1788744280.558695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:0.0:1788744280.558702:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2351:x1875634047440896:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744280.558730:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2351:x1875634047440896:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744280.558737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00080000:1.0:1788744280.559522:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744280.571896:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047440768 00000100:00100000:3.0:1788744280.571918:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047440768 00000100:00100000:2.0:1788744280.574077:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:2.0:1788744280.574117:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2351:x1875634047440768:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744280.574206:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2351:x1875634047440768:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 101us (20213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744280.574215:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00080000:1.0:1788744280.576156:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744280.798451:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788744281.695701:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1788744281.695723:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788744281.695733:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788744281.695767:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788744281.696043:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068447488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788744281.696125:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744281.697018:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068447488 00000100:00100000:1.0:1788744281.697029:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068447488 00000100:00100000:1.0:1788744281.697102:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788744281.697115:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068447488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788744281.697152:0:6680:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788744281.697196:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e1254, atime: 0x6a9e1254, ctime: 0x6a9e1254, blocks: 0x1 00010000:00010000:1.0:1788744281.697205:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.697226:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788744281.697231:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744281.697238:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.697277:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.697290:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.697298:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.697318:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788744281.698168:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068447488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1051us (2039us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788744281.698178:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788744281.698219:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744281.698228:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.698240:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744281.698245:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.698256:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.698275:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.698291:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b94861 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744281.698312:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744281.698314:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744281.698316:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788744281.698359:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940af73a8a80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788744281.698367:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068447488:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788744281.698592:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744281.830662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788744282.070395:0:11615:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788744282.852054:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744283.376188:0:11663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb88007b0 20000000:00000080:2.0:1788744283.376206:0:11663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940adbf35c00 uarg=0000000000000000 20000000:01000000:2.0:1788744283.376251:0:11663:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744283.376258:0:11663:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788744283.376262:0:11663:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788744283.379452:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788744283.379673:0:11663:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788744283.395448:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788744283.395509:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788744283.395611:0:11663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788744283.395647:0:11663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788744283.395668:0:11663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.395687:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.395694:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.395701:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396019:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396044:0:11663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396052:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396300:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396321:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 12 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.396338:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447616:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744283.396541:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396594:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 12 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.396603:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447744:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744283.396670:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.396679:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 18 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.396688:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447872:0@lo:104: 00000100:00100000:2.0:1788744283.396742:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744283.400457:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.400477:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 18 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.400491:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068448000:0@lo:104: 00000100:00100000:2.0:1788744283.400730:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744283.401188:0:11663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.401198:0:11663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 18 pid: 5828 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744283.401206:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068447872 00000100:00100000:2.0:1788744283.401207:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068448128:0@lo:104: 00000100:00100000:0.0:1788744283.401214:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068447872 00000100:00100000:2.0:1788744283.401240:0:11663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744283.401880:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f6780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744283.403791:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744283.403824:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448000 00000100:00100000:0.0:1788744283.403836:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448000 00000100:00100000:0.0:1788744283.403881:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448128 00000100:00100000:0.0:1788744283.403884:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448128 00000100:00100000:0.0:1788744283.403901:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744283.403912:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:11663:x1875634068447872:12345-0@lo:104: 00010000:00010000:0.0:1788744283.403931:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744283.404052:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744283.404058:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+5:11663:x1875634068447872:12345-0@lo:104: Request processed in 148us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744283.404065:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788744283.404099:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744283.404106:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:11663:x1875634068448000:12345-0@lo:104: 00010000:00010000:0.0:1788744283.404115:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744283.404150:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744283.404156:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+4:11663:x1875634068448000:12345-0@lo:104: Request processed in 51us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744283.404162:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788744283.404174:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744283.404180:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace368850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:11663:x1875634068448128:12345-0@lo:104: 00010000:00010000:0.0:1788744283.404187:0:5819:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744283.404216:0:5819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788744283.404221:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace368850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+3:11663:x1875634068448128:12345-0@lo:104: Request processed in 43us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744283.404226:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744283.405339:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447872:0@lo:104: 00000100:00100000:0.0:1788744283.405352:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068448000:0@lo:104: 00000100:00100000:0.0:1788744283.405360:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068448128:0@lo:104: 00010000:00010000:2.0:1788744283.405627:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788744283.405636:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405645:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296e00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744283.405650:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405659:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744283.405666:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744283.405693:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744283.405748:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405754:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744283.405783:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405790:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7296e00/0x7cd2bfd5e1b9471f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94726 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405804:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744283.405808:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405813:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc800 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744283.405815:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405822:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744283.405827:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744283.405832:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744283.405846:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405851:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744283.405875:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405882:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b94711 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b94718 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405892:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744283.405895:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405901:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744283.405904:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405911:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744283.405918:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744283.405923:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744283.405939:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405945:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744283.405950:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405956:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7388400/0x7cd2bfd5e1b94703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9470a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.405969:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744283.405977:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744283.405979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744283.405998:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068448256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744283.406057:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744283.406116:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068448384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744283.406139:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744283.406157:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744283.406162:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068448512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744283.406181:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744283.406212:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448256 00000100:00100000:2.0:1788744283.406219:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448256 00010000:00010000:2.0:1788744283.406248:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 19 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.406274:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448384 00000100:00100000:2.0:1788744283.406277:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448384 00010000:00010000:2.0:1788744283.406287:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 20 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.406297:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448512 00000100:00100000:2.0:1788744283.406300:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448512 00010000:00010000:2.0:1788744283.406307:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 21 pid: 5828 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.406319:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744283.406326:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+21:3313:x1875634068448256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744283.406341:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744283.406345:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 21 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406364:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 21 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406378:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fce00/0x7cd2bfd5e1b94726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9471f expref: 21 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406390:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744283.406429:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3313:x1875634068448256:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744283.406437:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744283.406453:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744283.406459:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068448384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744283.406470:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744283.406474:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 19 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406482:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 19 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406491:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b94718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94711 expref: 19 pid: 5830 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406500:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744283.406524:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:3310:x1875634068448384:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744283.406530:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744283.406542:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744283.406570:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3310:x1875634068448512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744283.406585:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744283.406590:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 17 pid: 5828 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406597:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 17 pid: 5828 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406607:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc400/0x7cd2bfd5e1b9470a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b94703 expref: 17 pid: 5828 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.406630:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744283.406653:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068448512:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744283.406658:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788744283.406716:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068448512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744283.406724:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068448384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744283.406750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068448256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744283.408420:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744283.410173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744283.410201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744283.410292:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447616:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744283.410304:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11663:1875634068447744:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744283.410345:0:11663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744283.410877:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441024 00000100:00100000:3.0:1788744283.410887:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441024 00010000:00010000:3.0:1788744283.410931:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 13 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744283.410968:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441152 00000100:00100000:3.0:1788744283.410972:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441152 00010000:00010000:3.0:1788744283.410984:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 14 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744283.411013:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:3.0:1788744283.411022:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ce62f61-9f0c-4e8b-869e-d738743a7119+14:2353:x1875634047441024:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744283.411054:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788744283.411054:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00010000:00010000:3.0:1788744283.411060:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 14 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744283.411061:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+14:2353:x1875634047441152:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744283.411069:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744283.411073:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 14 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.411079:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 14 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744283.411298:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389a00/0x7cd2bfd5e1b94734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761127 expref: 14 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418203:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 13 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418235:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7296800/0x7cd2bfd5e1b9472d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761120 expref: 13 pid: 5828 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418253:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418262:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418284:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418292:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418298:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418305:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418311:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744283.418315:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418323:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418359:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744283.418370:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744283.418446:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2353:x1875634047441152:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 7383us (8242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744283.418457:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00010000:00010000:0.0:1788744283.418754:0:11663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744283.418775:0:11663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744283.418790:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389c00/0x7cd2bfd5e1b94868 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744283.421751:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744283.423005:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2353:x1875634047441024:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 11966us (12823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744283.423020:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 33 00010000:00010000:2.0:1788744283.866855:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744284.187273:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068448640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744284.187370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.187441:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448640 00000100:00100000:3.0:1788744284.187450:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448640 00000100:00100000:1.0:1788744284.187462:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068449152:0@lo:400:kworker.0 00000100:00100000:1.0:1788744284.187498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.187519:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788744284.187525:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068448768:0@lo:400:kworker.0 00000100:00100000:3.0:1788744284.187538:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744284.187570:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068448640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744284.187578:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.187621:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068449280:0@lo:400:kworker.0 00002000:00000024:3.0:1788744284.187622:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744284.187655:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.187682:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068448640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.187690:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788744284.187723:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448768 00000100:00100000:3.0:1788744284.187727:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448768 00000100:00100000:3.0:1788744284.187750:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788744284.187757:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3312:x1875634068448768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744284.187787:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3312:x1875634068448768:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.187794:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788744284.187827:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449280 00000100:00100000:3.0:1788744284.187830:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449280 00000100:00100000:3.0:1788744284.187862:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788744284.187868:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068449280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744284.187900:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068449280:12345-0@lo:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.187905:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788744284.188148:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068449024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744284.188182:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744284.188216:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744284.188224:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068448896:0@lo:400:kworker.0 00000100:00100000:2.0:1788744284.188250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788744284.188258:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744284.188265:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744284.188278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449024 00000100:00100000:0.0:1788744284.188283:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449024 00000100:00100000:2.0:1788744284.188287:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449152 00000100:00100000:2.0:1788744284.188293:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449152 00000100:00100000:0.0:1788744284.188322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068448896 00000100:00100000:0.0:1788744284.188326:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068448896 00000100:00100000:2.0:1788744284.188335:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788744284.188347:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068449152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744284.188354:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788744284.188364:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068449024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744284.188386:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068449152:12345-0@lo:400:kworker.0 Request processed in 42us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744284.188395:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788744284.188413:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068449024:12345-0@lo:400:kworker.0 Request processed in 51us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.188421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788744284.188437:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068449024:0@lo:400:kworker.0 00000100:00100000:0.0:1788744284.188437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788744284.188447:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068448896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744284.188479:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068448896:12345-0@lo:400:kworker.0 Request processed in 35us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.188486:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1788744284.188502:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788744284.188504:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744284.188521:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068448896:0@lo:400:kworker.0 00010000:00080000:1.0:1788744284.188576:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad0c49c00 x1875634068448640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744284.188594:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068448640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744284.188628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068448768:0@lo:400:kworker.0 00000100:00100000:1.0:1788744284.188650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068449280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744284.188660:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068449152:0@lo:400:kworker.0 10000000:01000000:1.0:1788744284.443824:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744284.443835:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940b004f2800 from 7 10000000:01000000:1.0:1788744284.443840:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744284.443907:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.443921:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.443935:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744284.443965:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.444049:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.444135:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.444369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449408 00000100:00100000:0.0:1788744284.444378:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449408 00000100:00100000:0.0:1788744284.444446:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788744284.444456:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:5833:x1875634068449408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744284.444471:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744284.444485:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b94876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9486f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.444540:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b94876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9486f expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.444573:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b94876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9486f expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.444583:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297a00, rc 0) 00000100:00100000:0.0:1788744284.444647:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068449408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.444654:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788744284.444920:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744284.444938:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.444948:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744284.445011:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.445041:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.445074:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744284.445140:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449536 00000100:00100000:3.0:1788744284.445146:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449536 00000100:00100000:3.0:1788744284.445191:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788744284.445198:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068449536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.445482:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068449536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 284us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.445499:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788744284.445775:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.445808:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.445847:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.445877:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744284.446028:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449664 00000100:00100000:3.0:1788744284.446033:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449664 00000100:00100000:3.0:1788744284.446071:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788744284.446078:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068449664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.447658:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068449664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1574us (1803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.447670:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788744284.450584:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068449664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.453454:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11676:1875634068449792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744284.453607:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.453665:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af76200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.454984:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449792 00000100:00100000:0.0:1788744284.455008:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449792 00000100:00100000:0.0:1788744284.455073:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788744284.455083:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:11676:x1875634068449792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.456268:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:11676:x1875634068449792:12345-0@lo:502:llog_process_th.0 Request processed in 1183us (2667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.456279:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788744284.467296:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11676:1875634068449792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744284.467359:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744284.467376:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744284.467378:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788744284.467386:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff940b004f2800 00000020:00000080:1.0:1788744284.467389:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788744284.467519:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11676:1875634068449920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744284.467630:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.467681:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af76200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.473009:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068449920 00000100:00100000:0.0:1788744284.473026:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068449920 00000100:00100000:0.0:1788744284.473094:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788744284.473106:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:11676:x1875634068449920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.473411:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:11676:x1875634068449920:12345-0@lo:502:llog_process_th.0 Request processed in 307us (5780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.473419:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788744284.473900:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11676:1875634068449920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744284.473941:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744284.473950:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744284.473953:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788744284.473959:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788744284.480016:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788744284.480055:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744284.480083:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.480097:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744284.480110:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744284.480113:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940aceda7000 from 7 10000000:01000000:0.0:1788744284.480116:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744284.480161:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.480182:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.480196:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744284.480227:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744284.480311:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744284.480382:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c114c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744284.480453:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450048 00000100:00100000:1.0:1788744284.480462:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450048 00000100:00100000:1.0:1788744284.480518:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788744284.480528:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:5833:x1875634068450048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744284.480541:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744284.480605:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b94884 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9487d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.480630:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b94884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9487d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.480640:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b94884 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9487d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744284.480648:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3200, rc 0) 00000100:00100000:1.0:1788744284.480694:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.480701:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788744284.480928:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744284.480942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.480951:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744284.481063:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744284.481096:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744284.481127:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c114c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.481143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450176 00000100:00100000:0.0:1788744284.481147:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450176 00000100:00100000:0.0:1788744284.481354:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788744284.481362:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744284.481876:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.481884:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788744284.490828:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.490986:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.491084:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.491142:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744284.491467:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450304 00000100:00100000:1.0:1788744284.491476:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450304 00000100:00100000:1.0:1788744284.491571:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788744284.491581:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.491806:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af054c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 226us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.491814:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788744284.492035:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744284.492480:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11679:1875634068450432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.492541:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744284.492623:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c114c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744284.492736:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450432 00000100:00100000:3.0:1788744284.492741:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450432 00000100:00100000:3.0:1788744284.492771:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788744284.492779:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:11679:x1875634068450432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744284.492951:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:11679:x1875634068450432:12345-0@lo:502:llog_process_th.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744284.492958:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788744284.493139:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11679:1875634068450432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744284.493177:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744284.493187:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744284.493190:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744284.493201:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff940aceda7000 00000020:00000080:0.0:1788744284.493204:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744284.493279:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11679:1875634068450560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.493315:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744284.493346:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744284.493934:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450560 00000100:00100000:1.0:1788744284.493942:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450560 00000100:00100000:1.0:1788744284.493985:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788744284.494002:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:11679:x1875634068450560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744284.494180:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:11679:x1875634068450560:12345-0@lo:502:llog_process_th.0 Request processed in 187us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.494196:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788744284.494426:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11679:1875634068450560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744284.494451:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744284.494458:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744284.494464:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744284.494471:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788744284.496662:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788744284.496700:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744284.496712:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744284.496727:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744284.496738:0:5833:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788744284.496741:0:5833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac7f4d800 from 7 10000000:01000000:3.0:1788744284.496744:0:5833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788744284.496792:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744284.496800:0:5833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744284.496813:0:5833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744284.496842:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.496915:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.496968:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.497059:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450688 00000100:00100000:0.0:1788744284.497068:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450688 00000100:00100000:0.0:1788744284.497123:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788744284.497134:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:5833:x1875634068450688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744284.497148:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744284.497160:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7296a00/0x7cd2bfd5e1b94892 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9488b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.497184:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7296a00/0x7cd2bfd5e1b94892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9488b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.497194:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7296a00/0x7cd2bfd5e1b94892 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9488b expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744284.497202:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296a00, rc 0) 00000100:00100000:0.0:1788744284.497244:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068450688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.497251:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788744284.497967:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744284.497987:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744284.498021:0:5833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744284.498085:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.498120:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.498156:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.498313:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450816 00000100:00100000:0.0:1788744284.498320:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450816 00000100:00100000:0.0:1788744284.498361:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788744284.498369:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068450816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744284.498680:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068450816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.498687:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788744284.500918:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.501000:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744284.501080:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.501134:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744284.501444:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068450944 00000100:00100000:1.0:1788744284.501453:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068450944 00000100:00100000:1.0:1788744284.501507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788744284.501516:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068450944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.501758:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:5833:x1875634068450944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744284.501766:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788744284.503295:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:5833:1875634068450944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744284.503913:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11680:1875634068451072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744284.504007:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744284.504053:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae0760d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.505284:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451072 00000100:00100000:0.0:1788744284.505295:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451072 00000100:00100000:0.0:1788744284.505360:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788744284.505374:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:11680:x1875634068451072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.505685:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:11680:x1875634068451072:12345-0@lo:502:llog_process_th.0 Request processed in 311us (1689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.505693:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788744284.505923:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11680:1875634068451072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744284.505959:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744284.505968:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744284.505971:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788744284.505979:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff940ac7f4d800 00000020:00000080:3.0:1788744284.505982:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788744284.506078:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11680:1875634068451200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744284.506125:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744284.506171:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744284.506797:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451200 00000100:00100000:0.0:1788744284.506804:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451200 00000100:00100000:0.0:1788744284.506851:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788744284.506859:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:11680:x1875634068451200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744284.507034:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:11680:x1875634068451200:12345-0@lo:502:llog_process_th.0 Request processed in 174us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744284.507041:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788744284.507256:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:11680:1875634068451200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744284.507285:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744284.507292:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744284.507294:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788744284.507305:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788744284.507378:0:5833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788744284.507395:0:5833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744284.507407:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744284.507419:0:5833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744284.512441:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744284.891226:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744285.097184:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.099432:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441280 00000100:00100000:1.0:1788744285.099448:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441280 00000100:00100000:1.0:1788744285.099533:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 274 00000100:00100000:1.0:1788744285.099544:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:5595:x1875634047441280:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744285.099606:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744285.099630:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b94899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761174 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.099667:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b94899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761174 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.099679:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b94899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761174 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.099689:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2c00, rc 0) 00000100:00100000:1.0:1788744285.100168:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441280:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 624us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.100177:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 274 00000100:00100000:2.0:1788744285.103662:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.104317:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441408 00000100:00100000:1.0:1788744285.104329:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441408 00000100:00100000:1.0:1788744285.104393:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 275 00000100:00100000:1.0:1788744285.104405:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441408:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744285.104845:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441408:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 440us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.104856:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 275 00000100:00100000:0.0:1788744285.107802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.108346:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441536 00000100:00100000:1.0:1788744285.108359:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441536 00000100:00100000:1.0:1788744285.108441:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 276 00000100:00100000:1.0:1788744285.108451:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441536:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744285.108918:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441536:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 466us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.108928:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 276 00000100:00100000:2.0:1788744285.125285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744285.126443:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441664 00000100:00100000:0.0:1788744285.126455:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441664 00000100:00100000:0.0:1788744285.126534:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 277 00000100:00100000:0.0:1788744285.126545:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:9962:x1875634047441664:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744285.127101:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:9962:x1875634047441664:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 555us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744285.127110:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 277 00000100:00100000:2.0:1788744285.152924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.157080:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441792 00000100:00100000:1.0:1788744285.157101:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441792 00000100:00100000:1.0:1788744285.157191:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 278 00000100:00100000:1.0:1788744285.157204:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:9962:x1875634047441792:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744285.157526:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:9962:x1875634047441792:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 324us (4684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.157535:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 278 00000100:00100000:2.0:1788744285.163602:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.163876:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047441920 00000100:00100000:1.0:1788744285.163902:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047441920 00000100:00100000:1.0:1788744285.163969:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 279 00000100:00100000:1.0:1788744285.163981:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:5595:x1875634047441920:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744285.164002:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744285.164020:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b948a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576117b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.164050:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b948a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576117b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.164060:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b948a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576117b expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744285.164069:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2200, rc 0) 00000100:00100000:1.0:1788744285.164137:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047441920:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 157us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.164145:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 279 00000100:00100000:0.0:1788744285.176733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744285.176982:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442048 00000100:00100000:3.0:1788744285.176994:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442048 00000100:00100000:3.0:1788744285.177060:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 280 00000100:00100000:3.0:1788744285.177071:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047442048:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744285.177714:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047442048:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 643us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744285.177723:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 280 00000100:00100000:2.0:1788744285.179690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.180073:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442176 00000100:00100000:1.0:1788744285.180085:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442176 00000100:00100000:1.0:1788744285.180148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 281 00000100:00100000:1.0:1788744285.180159:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047442176:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744285.186003:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:5595:x1875634047442176:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 5832us (6316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.186020:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 281 00000100:00100000:2.0:1788744285.190245:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.191172:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442304 00000100:00100000:1.0:1788744285.191204:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442304 00000100:00100000:1.0:1788744285.191280:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 282 00000100:00100000:1.0:1788744285.191293:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:9965:x1875634047442304:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744285.191992:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac3f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:9965:x1875634047442304:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 698us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.192001:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 282 00000100:00100000:0.0:1788744285.210253:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744285.211752:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744285.211773:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068451328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744285.211834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744285.212380:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451328 00000100:00100000:3.0:1788744285.212390:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451328 00000100:00100000:3.0:1788744285.212444:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788744285.212453:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068451328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744285.212488:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744285.212568:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068451328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744285.212576:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744285.212930:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068451328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744285.213624:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442432 00000100:00100000:1.0:1788744285.213634:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442432 00000100:00100000:1.0:1788744285.213693:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 283 00000100:00100000:1.0:1788744285.213702:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:9965:x1875634047442432:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744285.214320:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:9965:x1875634047442432:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 613us (4071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.214331:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 283 00000040:00080000:3.0:1788744285.531283:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744285.679617:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744285.679660:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744285.679697:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744285.679734:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744285.679838:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442816 00000100:00100000:1.0:1788744285.679852:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442816 00000100:00100000:1.0:1788744285.679946:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744285.679960:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047442816:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744285.680067:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047442816:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 110us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.680075:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744285.680109:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442560 00000100:00100000:1.0:1788744285.680113:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442560 00000100:00100000:1.0:1788744285.680141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 284 00000100:00100000:1.0:1788744285.680148:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047442560:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744285.680173:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047442560:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744285.680180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 284 00000100:00100000:0.0:1788744285.680294:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442688 00000100:00100000:0.0:1788744285.680303:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442688 00000100:00100000:0.0:1788744285.680340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047442944 00000100:00100000:0.0:1788744285.680343:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047442944 00000100:00100000:0.0:1788744285.680380:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:0.0:1788744285.680388:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047442688:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744285.680421:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047442688:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 35us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744285.680428:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:0.0:1788744285.680444:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00100000:0.0:1788744285.680450:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047442944:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744285.680475:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047442944:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744285.680480:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00080000:2.0:1788744285.680815:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744285.680821:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788744285.916344:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788744286.920063:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1788744286.940525:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744287.962902:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744288.990702:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744289.307209:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068451456:0@lo:400:kworker.0 00000100:00100000:0.0:1788744289.307444:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744289.307704:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.307742:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744289.307775:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744289.307781:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.307816:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744289.307859:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451712 00000100:00100000:2.0:1788744289.307868:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451712 00000100:00100000:2.0:1788744289.308103:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451584 00000100:00100000:2.0:1788744289.308107:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451584 00000100:00100000:2.0:1788744289.308140:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788744289.308150:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068451712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.308206:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068451712:12345-0@lo:400:kworker.0 Request processed in 58us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744289.308213:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788744289.308230:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788744289.308236:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.308264:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068451584:12345-0@lo:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744289.308269:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:2.0:1788744289.309039:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744289.309095:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.309111:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068451712:0@lo:400:kworker.0 00000100:00100000:2.0:1788744289.311306:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451456 00000100:00100000:2.0:1788744289.311322:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451456 00000100:00100000:2.0:1788744289.311395:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788744289.311406:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068451456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744289.315529:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068451968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744289.315632:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744289.315889:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068451840:0@lo:400:kworker.0 00000100:00100000:1.0:1788744289.315927:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744289.316035:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068452096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744289.316065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744289.316634:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068451456:12345-0@lo:400:kworker.0 Request processed in 5227us (9188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744289.316646:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788744289.316685:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451840 00000100:00100000:2.0:1788744289.316708:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451840 00000100:00100000:0.0:1788744289.322407:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068451456:0@lo:400:kworker.0 00000100:00080000:0.0:1788744289.322586:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744289.322604:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068452224:0@lo:400:kworker.0 00000100:00100000:3.0:1788744289.322946:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068451968 00000100:00100000:3.0:1788744289.322954:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068451968 00000100:00100000:3.0:1788744289.323027:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744289.323037:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068451968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744289.323086:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744289.325014:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788744289.325036:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068451840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744289.327820:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744289.327921:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452224 00000100:00100000:0.0:1788744289.327930:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452224 00000100:00100000:0.0:1788744289.327976:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744289.328003:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068452224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744289.328521:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068451968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5483us (12887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.328531:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744289.328573:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452096 00000100:00100000:3.0:1788744289.328579:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452096 00000100:00100000:3.0:1788744289.328614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788744289.328622:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068452096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744289.328681:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068452096:12345-0@lo:400:kworker.0 Request processed in 60us (12615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744289.328688:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1788744289.328713:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744289.328718:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788744289.328749:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73adc00 x1875634068451968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744289.328908:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068452224:12345-0@lo:400:kworker.0 Request processed in 906us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744289.328916:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744289.328955:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068452096:0@lo:400:kworker.0 00000100:00100000:3.0:1788744289.329283:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068451968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744289.333897:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068451840:12345-0@lo:400:kworker.0 Request processed in 8851us (17947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744289.333928:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788744289.338951:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940b00ba2300 x1875634068452224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744289.338976:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068452224:0@lo:400:kworker.0 00000100:00100000:0.0:1788744289.341257:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788744289.341269:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940af73a8a80, transno 4294967300 00000100:00100000:0.0:1788744289.341350:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068451840:0@lo:400:kworker.0 00010000:00010000:2.0:1788744290.012280:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744290.331150:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744290.331174:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068452352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744290.331244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744290.331475:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452352 00000100:00100000:2.0:1788744290.331493:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452352 00000100:00100000:2.0:1788744290.331570:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744290.331581:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068452352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744290.331619:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744290.331674:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068452352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744290.331682:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744290.331913:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068452352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744290.792288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744290.792323:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744290.792344:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744290.792371:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744290.792408:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443072 00000100:00100000:3.0:1788744290.792418:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443072 00000100:00100000:3.0:1788744290.792484:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 286 00000100:00100000:3.0:1788744290.792494:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047443072:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744290.792817:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443328 00000100:00100000:1.0:1788744290.792822:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443328 00000100:00100000:1.0:1788744290.792859:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:1.0:1788744290.792866:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443328:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744290.792927:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443328:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 61us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744290.792934:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00080000:1.0:1788744290.792962:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744290.793193:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047443072:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 700us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744290.793200:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 286 00000100:00100000:2.0:1788744290.796134:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443200 00000100:00100000:2.0:1788744290.796150:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443200 00000100:00100000:2.0:1788744290.796236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443456 00000100:00100000:2.0:1788744290.796240:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443456 00000100:00100000:2.0:1788744290.796289:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 127 00000100:00100000:2.0:1788744290.796299:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443200:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744290.796386:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443200:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 77us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744290.796393:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 127 00000100:00100000:2.0:1788744290.796411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00100000:2.0:1788744290.796418:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047443456:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744290.796441:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047443456:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744290.796448:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00080000:1.0:1788744290.799484:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744291.034897:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744292.059325:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744293.084016:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744294.114485:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744294.431131:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068452480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744294.432114:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.432294:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452480 00000100:00100000:1.0:1788744294.432306:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452480 00000100:00100000:1.0:1788744294.432377:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788744294.432389:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068452480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744294.432460:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744294.434289:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068452480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1894us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744294.434303:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788744294.434342:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788744294.434397:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad31e7100 x1875634068452480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744294.434437:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068452480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744294.439324:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068452736:0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439426:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.439474:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788744294.439481:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068452608:0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439515:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.439564:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068453120:0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439589:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.439623:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068452864:0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439646:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.439665:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744294.439670:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068452992:0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439695:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744294.439729:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452608 00000100:00100000:1.0:1788744294.439739:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452608 00000100:00100000:1.0:1788744294.439791:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788744294.439801:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068452608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744294.439859:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068452608:12345-0@lo:400:kworker.0 Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744294.439883:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788744294.439953:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068452608:0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441151:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452736 00000100:00100000:2.0:1788744294.441182:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452736 00000100:00100000:2.0:1788744294.441223:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453120 00000100:00100000:2.0:1788744294.441226:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453120 00000100:00100000:2.0:1788744294.441256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452864 00000100:00100000:2.0:1788744294.441259:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452864 00000100:00100000:2.0:1788744294.441275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744294.441283:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441356:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068452736:12345-0@lo:400:kworker.0 Request processed in 74us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744294.441363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788744294.441378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744294.441384:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068453120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441422:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068453120:12345-0@lo:400:kworker.0 Request processed in 39us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744294.441428:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788744294.441439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788744294.441444:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068452864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441477:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068452864:12345-0@lo:400:kworker.0 Request processed in 33us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744294.441483:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788744294.441508:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744294.441541:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068453120:0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441569:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068452736:0@lo:400:kworker.0 00000100:00100000:2.0:1788744294.441601:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068452864:0@lo:400:kworker.0 00000100:00100000:0.0:1788744294.446126:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068452992 00000100:00100000:0.0:1788744294.446148:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068452992 00000100:00100000:0.0:1788744294.446765:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744294.446778:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068452992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744294.446902:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068452992:12345-0@lo:400:kworker.0 Request processed in 128us (7205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744294.446910:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788744294.446938:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744294.448727:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068452992:0@lo:400:kworker.0 00010000:00010000:1.0:1788744295.130831:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744295.453598:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068453248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744295.453700:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744295.453971:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453248 00000100:00100000:2.0:1788744295.453981:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453248 00000100:00100000:2.0:1788744295.454069:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788744295.454085:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068453248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744295.454133:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744295.454204:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068453248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744295.454213:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788744295.454320:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068453248:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788744295.771502:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788744295.913469:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744295.913518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744295.913625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744295.913658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744295.913787:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443712 00000100:00100000:0.0:1788744295.913802:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443712 00000100:00100000:0.0:1788744295.913889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443968 00000100:00100000:0.0:1788744295.913893:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443968 00000100:00100000:0.0:1788744295.913921:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 132 00000100:00100000:0.0:1788744295.913935:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443712:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744295.914062:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047443712:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 130us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744295.914091:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 132 00000100:00100000:0.0:1788744295.914114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 133 00000100:00100000:0.0:1788744295.914121:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047443968:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744295.914149:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047443968:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744295.914155:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 133 00000100:00080000:0.0:1788744295.914176:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744295.914353:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443840 00000100:00100000:2.0:1788744295.914358:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443840 00000100:00100000:3.0:1788744295.914510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047443584 00000100:00100000:3.0:1788744295.914515:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047443584 00000100:00100000:3.0:1788744295.914571:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 288 00000100:00100000:3.0:1788744295.914579:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047443584:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744295.914621:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047443584:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 43us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744295.914627:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 288 00000100:00080000:0.0:1788744295.915331:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744295.915488:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:2.0:1788744295.915503:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047443840:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744295.915610:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047443840:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 112us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744295.915617:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00010000:00010000:1.0:1788744296.154859:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744297.179104:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744298.203194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744299.226777:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744299.547601:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068453504:0@lo:400:kworker.0 00000100:00100000:1.0:1788744299.547678:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744299.547741:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744299.547769:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744299.547799:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788744299.547805:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068453376:0@lo:400:kworker.0 00000100:00100000:1.0:1788744299.547840:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744299.547877:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068453888:0@lo:400:kworker.0 00000100:00100000:3.0:1788744299.547885:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068453760:0@lo:400:kworker.0 00000100:00100000:1.0:1788744299.547907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744299.547932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744299.547957:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788744299.547963:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788744299.547982:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744299.548019:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068454144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744299.548041:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744299.548086:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454144 00000100:00100000:3.0:1788744299.548094:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454144 00000100:00100000:2.0:1788744299.548108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453376 00000100:00100000:2.0:1788744299.548112:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453376 00000100:00100000:2.0:1788744299.548141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788744299.548143:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788744299.548150:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068454144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744299.548150:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068453376:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788744299.548189:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744299.548197:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068453376:12345-0@lo:400:kworker.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744299.548204:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788744299.548219:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068454144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744299.548225:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788744299.548391:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453504 00000100:00100000:0.0:1788744299.548396:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453504 00000100:00100000:0.0:1788744299.548422:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453888 00000100:00100000:0.0:1788744299.548424:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453888 00000100:00100000:0.0:1788744299.548441:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453632 00000100:00100000:0.0:1788744299.548443:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453632 00000100:00100000:0.0:1788744299.548456:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744299.548461:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068453504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548495:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068453504:12345-0@lo:400:kworker.0 Request processed in 34us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744299.548501:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788744299.548512:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788744299.548517:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548537:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875634068453888:12345-0@lo:400:kworker.0 Request processed in 21us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744299.548543:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788744299.548579:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788744299.548584:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068453632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548621:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068453632:12345-0@lo:400:kworker.0 Request processed in 36us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744299.548627:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788744299.548644:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068453376:0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548647:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454016 00000100:00100000:0.0:1788744299.548652:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454016 00000100:00100000:1.0:1788744299.548662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068453888:0@lo:400:kworker.0 00000100:00100000:1.0:1788744299.548674:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068453504:0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548677:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068453760 00000100:00100000:0.0:1788744299.548681:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068453760 00000100:00100000:0.0:1788744299.548709:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744299.548716:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788744299.548720:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744299.548726:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744299.548729:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744299.548754:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744299.548756:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454016:12345-0@lo:400:kworker.0 Request processed in 38us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744299.548766:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068453760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744299.548766:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788744299.548815:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068453760:12345-0@lo:400:kworker.0 Request processed in 52us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744299.548822:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788744299.548828:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad31e6680 x1875634068454016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744299.548840:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788744299.571084:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068453632:0@lo:400:kworker.0 00010000:00080000:3.0:1788744299.571108:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73aca80 x1875634068454144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744299.571128:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068454144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744299.571142:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068453760:0@lo:400:kworker.0 00010000:00010000:1.0:1788744300.253201:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744300.570945:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744300.571018:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744300.571232:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454272 00000100:00100000:2.0:1788744300.571241:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454272 00000100:00100000:2.0:1788744300.571318:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788744300.571344:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068454272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744300.571390:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744300.571453:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068454272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744300.571461:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788744300.571748:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068454272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744301.033657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744301.033726:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744301.033811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444096 00000100:00100000:3.0:1788744301.033823:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444096 00000100:00100000:3.0:1788744301.033884:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 290 00000100:00100000:3.0:1788744301.033895:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047444096:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744301.033975:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047444096:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 82us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744301.033983:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 290 00000100:00100000:1.0:1788744301.036468:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444224 00000100:00100000:1.0:1788744301.036485:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444224 00000100:00100000:1.0:1788744301.036626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 137 00000100:00100000:1.0:1788744301.036639:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047444224:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744301.036747:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047444224:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 111us (3099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744301.036754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 137 00000100:00080000:0.0:1788744301.037916:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744301.072679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744301.072910:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444352 00000100:00100000:2.0:1788744301.072925:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444352 00000100:00100000:2.0:1788744301.073045:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:2.0:1788744301.073059:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2350:x1875634047444352:12345-192.168.204.56@tcp:9:kworker.0 00000020:00000080:2.0:1788744301.073098:0:6680:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b947dc 00000100:00080000:2.0:1788744301.073111:0:6680:0:(import.c:65:import_set_state_nolock()) ffff940ad0c1a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788744301.073168:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788744301.074171:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+2:2350:x1875634047444352:12345-192.168.204.56@tcp:9:kworker.0 Request processed in 1111us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744301.074180:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00010000:00010000:1.0:1788744301.074592:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744301.075470:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744301.100833:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744301.101066:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444480 00000100:00100000:0.0:1788744301.101080:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444480 00000100:00100000:0.0:1788744301.101176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 138 00000100:00100000:0.0:1788744301.101191:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047444480:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744301.101288:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047444480:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 100us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744301.101324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 138 00000100:00080000:1.0:1788744301.104803:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744301.274955:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744302.172986:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:2.0:1788744302.172996:0:6708:0:(genops.c:885:class_export_put()) final put ffff940ad0c18800/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:1.0:1788744302.173067:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad0c18800/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-OST0000 00000020:00000080:1.0:1788744302.173118:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ad0c1a000 for lustre-OST0000 00010000:00010000:1.0:1788744302.298824:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744303.324877:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744304.346933:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744304.666833:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744304.669099:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744304.669173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744304.669247:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068454400:0@lo:400:kworker.0 00000100:00100000:2.0:1788744304.671608:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744304.671665:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744304.671677:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454912:0@lo:400:kworker.0 00000100:00100000:2.0:1788744304.671706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744304.672517:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454528 00000100:00100000:2.0:1788744304.672540:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454528 00000100:00100000:2.0:1788744304.672627:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744304.672638:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788744304.672675:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744304.672726:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (3552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744304.672734:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744304.672757:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454400 00000100:00100000:2.0:1788744304.672761:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454400 00000100:00100000:2.0:1788744304.672787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788744304.672794:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068454400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744304.672827:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068454400:12345-0@lo:400:kworker.0 Request processed in 34us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744304.672833:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:2.0:1788744304.672857:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788744304.672890:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad31e6d80 x1875634068454528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744304.672911:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744304.672922:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068454400:0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.674846:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068454656:0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.674905:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744304.674943:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744304.674951:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068454784:0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.674975:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744304.675014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454656 00000100:00100000:0.0:1788744304.675020:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454656 00000100:00100000:0.0:1788744304.675058:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454784 00000100:00100000:0.0:1788744304.675062:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454784 00000100:00100000:0.0:1788744304.675089:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788744304.675096:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068454656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.675145:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068454656:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744304.675152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788744304.675169:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788744304.675174:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068454784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.675201:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068454784:12345-0@lo:400:kworker.0 Request processed in 26us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744304.675220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788744304.675241:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744304.675249:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068455040:0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.675890:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744304.675951:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068454784:0@lo:400:kworker.0 00000100:00100000:0.0:1788744304.675964:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068454656:0@lo:400:kworker.0 00000100:00100000:2.0:1788744304.676179:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455040 00000100:00100000:2.0:1788744304.676186:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455040 00000100:00100000:2.0:1788744304.676232:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788744304.676240:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068455040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744304.676311:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068455040:12345-0@lo:400:kworker.0 Request processed in 72us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744304.676318:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1788744304.676351:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744304.676472:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068455040:0@lo:400:kworker.0 00000100:00100000:1.0:1788744304.679318:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068454912 00000100:00100000:1.0:1788744304.679330:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068454912 00000100:00100000:1.0:1788744304.679410:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788744304.679421:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744304.679695:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068454912:12345-0@lo:400:kworker.0 Request processed in 275us (7986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744304.679703:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788744304.679735:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744304.681723:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068454912:0@lo:400:kworker.0 00010000:00010000:1.0:1788744305.374023:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744305.707893:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744305.707925:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068455168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744305.708027:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744305.708142:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455168 00000100:00100000:3.0:1788744305.708151:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455168 00000100:00100000:3.0:1788744305.708213:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744305.708223:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068455168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744305.708276:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744305.708327:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068455168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744305.708336:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788744305.708384:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068455168:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788744306.027460:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788744306.162812:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744306.162867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744306.162890:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444736 00000100:00100000:3.0:1788744306.162895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744306.162900:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444736 00000100:00100000:3.0:1788744306.162914:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444608 00000100:00100000:3.0:1788744306.162918:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444608 00000100:00100000:1.0:1788744306.162949:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444864 00000100:00100000:1.0:1788744306.162952:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444864 00000100:00100000:3.0:1788744306.162953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 292 00000100:00100000:3.0:1788744306.162962:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047444608:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744306.162969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 142 00000100:00100000:1.0:1788744306.162975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047444736:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744306.164290:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047444608:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 1320us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744306.164302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 292 00000100:00100000:0.0:1788744306.164594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 143 00000100:00100000:0.0:1788744306.164609:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047444864:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744306.177024:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047444736:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 14035us (14209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744306.177055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 142 00000100:00080000:1.0:1788744306.177103:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744306.179121:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047444864:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 14509us (16215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744306.179135:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 143 00010000:00010000:1.0:1788744306.396785:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744307.429915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744308.448806:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744309.468187:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744309.495242:0:11847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:25:07 (1788744307) 00000100:00100000:3.0:1788744309.791468:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068455296:0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.791762:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744309.791840:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068455808:0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.791873:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744309.791912:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744309.791921:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.791949:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744309.792001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455808 00000100:00100000:3.0:1788744309.792011:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455808 00000100:00100000:3.0:1788744309.792090:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788744309.792126:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.792202:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068455808:12345-0@lo:400:kworker.0 Request processed in 78us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.792209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788744309.792239:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455680 00000100:00100000:3.0:1788744309.792243:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455680 00000100:00100000:3.0:1788744309.792286:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744309.792294:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068455680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.792327:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068455680:12345-0@lo:400:kworker.0 Request processed in 34us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.792332:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788744309.792350:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788744309.792356:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744309.792400:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068455680:0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.792413:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068455808:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.793586:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068455424:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.793643:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744309.793675:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068455936:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.793699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744309.793721:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744309.793727:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068455552:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.793744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744309.793796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455296 00000100:00100000:2.0:1788744309.793804:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455296 00000100:00100000:2.0:1788744309.793843:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788744309.793851:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068455296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.794211:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068455296:12345-0@lo:400:kworker.0 Request processed in 359us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744309.794220:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788744309.794270:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455424 00000100:00100000:2.0:1788744309.794274:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455424 00000100:00100000:2.0:1788744309.794305:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455552 00000100:00100000:2.0:1788744309.794308:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455552 00000100:00100000:2.0:1788744309.794345:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00080000:3.0:1788744309.795706:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744309.795741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744309.795759:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068455552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.795859:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068455552:12345-0@lo:400:kworker.0 Request processed in 108us (2113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.795868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788744309.795930:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068455296:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.796738:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068455424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.796808:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068455424:12345-0@lo:400:kworker.0 Request processed in 83us (3163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744309.796815:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788744309.796853:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068455936 00000100:00100000:2.0:1788744309.796861:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068455936 00000100:00100000:2.0:1788744309.797450:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744309.797461:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068455936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.797510:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068455936:12345-0@lo:400:kworker.0 Request processed in 53us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744309.797517:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744309.797602:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068456064:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788744309.797612:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744309.797664:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744309.797761:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068455552:0@lo:400:kworker.0 00000100:00100000:2.0:1788744309.797777:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068455424:0@lo:400:kworker.0 00010000:00080000:2.0:1788744309.797793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940afa6f3b80 x1875634068455936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788744325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744309.797804:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068455936:0@lo:400:kworker.0 00000100:00100000:3.0:1788744309.797861:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068456064 00000100:00100000:3.0:1788744309.797867:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068456064 00000100:00100000:3.0:1788744309.797904:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788744309.797912:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068456064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744309.797955:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744309.798015:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068456064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744309.798024:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1788744309.803338:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad31e7b80 x1875634068456064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744309.803379:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068456064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788744310.491077:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744310.811040:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744310.811067:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068456192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744310.811160:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744310.811256:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068456192 00000100:00100000:1.0:1788744310.811264:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068456192 00000100:00100000:1.0:1788744310.827328:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788744310.827352:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068456192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744310.827392:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744310.827642:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068456192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 302us (16482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744310.827650:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744310.828493:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068456192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744311.277604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744311.277832:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047444992 00000100:00100000:2.0:1788744311.277853:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047444992 00000100:00100000:2.0:1788744311.277942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 294 00000100:00100000:2.0:1788744311.277979:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047444992:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744311.278108:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047444992:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744311.278120:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 294 00000100:00100000:2.0:1788744311.280628:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744311.280680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744311.280764:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445248 00000100:00100000:3.0:1788744311.280776:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445248 00000100:00100000:3.0:1788744311.280860:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445120 00000100:00100000:3.0:1788744311.280863:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445120 00000100:00100000:3.0:1788744311.280893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 147 00000100:00100000:3.0:1788744311.280906:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047445248:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744311.281009:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047445248:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 107us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744311.281018:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 147 00000100:00100000:3.0:1788744311.281039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 148 00000100:00100000:3.0:1788744311.281046:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047445120:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744311.281077:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047445120:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744311.281097:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 148 00000100:00080000:1.0:1788744311.281347:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744311.515432:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744311.857020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744311.860276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445376 00000100:00100000:2.0:1788744311.860303:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445376 00000100:00100000:2.0:1788744311.860428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:2.0:1788744311.860443:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:10236:x1875634047445376:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744311.860473:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744311.860508:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b948a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761182 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861082:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861105:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861125:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744311.861179:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744311.861183:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744311.861299:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861335:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b948a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761182 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861381:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761182 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.861391:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:2.0:1788744311.861395:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744311.861399:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389800, rc 0) 00000100:00100000:2.0:1788744311.861510:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:10236:x1875634047445376:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1070us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744311.861519:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:3.0:1788744311.877420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744311.880709:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445504 00000100:00100000:1.0:1788744311.880728:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445504 00000100:00100000:1.0:1788744311.881026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:1.0:1788744311.881040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:10237:x1875634047445504:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744311.881161:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744311.881188:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b948b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761189 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881264:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881281:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881299:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881315:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881323:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881330:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881695:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881706:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881726:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744311.881756:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788744311.881760:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744311.881783:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881793:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881801:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881808:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881814:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744311.881819:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881827:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881838:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:1.0:1788744311.881841:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744311.881846:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881853:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b948bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881876:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881882:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881889:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881894:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744311.881896:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881902:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881909:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff940ac3570400) 00010000:00010000:1.0:1788744311.881911:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744311.881914:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881918:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b948c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881953:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b948b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761189 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881968:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761189 expref: 7 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744311.881987:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ac3570c00) 00010000:00010000:1.0:1788744311.881990:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744311.881992:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2400, rc 0) 00000100:00100000:1.0:1788744311.882183:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:10237:x1875634047445504:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1145us (4772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744311.882192:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:3.0:1788744311.893891:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744311.894023:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445760 00000100:00100000:2.0:1788744311.894035:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445760 00000100:00100000:2.0:1788744311.894123:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:2.0:1788744311.894135:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+7:10237:x1875634047445760:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744311.894166:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744311.894188:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b948d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761190 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894387:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894403:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894414:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894449:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894472:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.894479:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895295:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b948e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895309:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b948e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895316:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b948e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744311.895327:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788744311.895478:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895487:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895494:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895501:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744311.895507:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895514:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895576:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ac3570c00) 00010000:00010000:2.0:1788744311.895580:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744311.895586:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895593:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b948d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895608:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895615:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895621:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895627:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744311.895631:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895637:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895645:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff940ac2bbc600) 00010000:00010000:2.0:1788744311.895647:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744311.895650:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.895656:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b948df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.896153:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b948d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761190 expref: 10 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.896172:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b948e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761190 expref: 9 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744311.896180:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:2.0:1788744311.896183:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744311.896185:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388a00, rc 0) 00000100:00100000:2.0:1788744311.896280:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+9:10237:x1875634047445760:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 2145us (2399us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788744311.896289:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:0.0:1788744311.906114:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744311.906248:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047445888 00000100:00100000:2.0:1788744311.906260:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047445888 00000100:00100000:2.0:1788744311.906335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:2.0:1788744311.906347:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:10237:x1875634047445888:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788744311.906490:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:10237:x1875634047445888:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 Request processed in 145us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744311.906498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 35 00000040:00080000:2.0:1788744312.156155:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1788744312.404821:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788744312.543497:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744313.563585:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744313.651810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744313.651896:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446016 00000100:00100000:1.0:1788744313.651907:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446016 00000100:00100000:1.0:1788744313.651978:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:1.0:1788744313.651992:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:10279:x1875634047446016:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744313.652017:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744313.652051:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b948f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761197 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652131:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652149:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652162:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652179:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652195:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652217:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652618:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652628:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652634:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652640:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744313.652644:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652652:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652665:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:1.0:1788744313.652668:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744313.652674:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652680:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b948fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652693:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652699:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652714:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652718:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744313.652722:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652728:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652735:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff940ac3570d00) 00010000:00010000:1.0:1788744313.652738:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744313.652740:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652746:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652781:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b948f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761197 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652791:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:1.0:1788744313.652793:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744313.652797:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b948f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761197 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.652806:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3e00, rc 0) 00000100:00100000:1.0:1788744313.652868:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:10279:x1875634047446016:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 880us (1073us total) trans 0 rc 301/301 00000100:00100000:1.0:1788744313.652888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00080000:0.0:1788744313.653227:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744313.668995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744313.669080:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446272 00000100:00100000:1.0:1788744313.669091:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446272 00000100:00100000:1.0:1788744313.669154:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:1.0:1788744313.669165:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+8:10279:x1875634047446272:12345-192.168.204.56@tcp:36:lfs.0 00010000:00010000:1.0:1788744313.669237:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744313.669265:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b948ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761182 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669286:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:1.0:1788744313.669296:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744313.669538:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669596:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669610:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669634:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669642:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.669649:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744313.670718:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788744313.670738:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670747:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670755:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670763:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744313.670767:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670775:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670789:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac3570d00) 00010000:00010000:1.0:1788744313.670792:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744313.670796:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744313.670802:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94909 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744313.670819:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cd3af1c4 reply state 0000000056322b11 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744313.670827:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744313.670949:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+9:10279:x1875634047446272:12345-192.168.204.56@tcp:36:lfs.0 Request processed in 1782us (1961us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788744313.670957:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 37 00010000:00010000:3.0:1788744313.686973:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687018:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687026:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687044:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744313.687051:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687060:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687080:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff940ac3570400) 00010000:00010000:3.0:1788744313.687084:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744313.687090:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.687096:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94910 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744313.771698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744313.772159:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446400 00000100:00100000:3.0:1788744313.772177:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446400 00000100:00100000:3.0:1788744313.772366:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:3.0:1788744313.772377:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:10287:x1875634047446400:12345-192.168.204.56@tcp:101:lctl.0 00010000:00010000:3.0:1788744313.772407:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744313.772435:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94917 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576119e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772537:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772579:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772592:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744313.772632:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744313.772636:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744313.772680:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772706:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94917 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576119e expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772728:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576119e expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.772738:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:3.0:1788744313.772742:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744313.772746:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031e00, rc 0) 00000100:00100000:3.0:1788744313.773059:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+9:10287:x1875634047446400:12345-192.168.204.56@tcp:101:lctl.0 Request processed in 682us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744313.773067:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:0.0:1788744313.861343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.861438:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446528 00000100:00100000:2.0:1788744313.861450:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446528 00000100:00100000:2.0:1788744313.861519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:2.0:1788744313.861530:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:10293:x1875634047446528:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744313.861791:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744313.861824:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611a5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862027:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862053:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862066:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862085:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862091:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862098:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862205:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862211:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744313.862242:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788744313.862254:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744313.862300:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862314:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862321:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862328:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862334:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744313.862339:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862346:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862359:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:2.0:1788744313.862362:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744313.862367:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862373:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9492c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862966:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862976:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.862998:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863003:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744313.863007:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863014:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863023:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff940ac2bbc400) 00010000:00010000:2.0:1788744313.863025:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744313.863040:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863046:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94933 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863088:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611a5 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863166:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611a5 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.863176:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744313.863179:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788744313.863181:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389a00, rc 0) 00000100:00100000:2.0:1788744313.863264:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+10:10293:x1875634047446528:12345-192.168.204.56@tcp:101:bash.0 Request processed in 1735us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744313.863281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:0.0:1788744313.868681:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.868778:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446784 00000100:00100000:2.0:1788744313.868791:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446784 00000100:00100000:2.0:1788744313.868881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:2.0:1788744313.868894:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+10:10293:x1875634047446784:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744313.868922:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744313.868946:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94941 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.869136:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.869153:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.869168:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.869998:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.870019:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.870040:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744313.887365:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788744313.892049:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892084:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892098:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892139:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892147:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892155:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892162:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744313.892166:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892174:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892188:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744313.892190:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744313.892195:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.892201:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94948 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744313.892218:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000aaa90fc4 reply state 00000000a7256ca2 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744313.892231:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744313.896444:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.896482:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.896491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744313.896494:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744313.896498:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388600, rc 0) 00000100:00100000:2.0:1788744313.896604:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10293:x1875634047446784:12345-192.168.204.56@tcp:101:bash.0 Request processed in 27712us (27940us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788744313.896614:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:0.0:1788744313.901122:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.901245:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047446912 00000100:00100000:2.0:1788744313.901255:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047446912 00000100:00100000:2.0:1788744313.901301:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744313.901310:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875634047446912:12345-192.168.204.56@tcp:8:bash.0 00010000:00080000:2.0:1788744313.901353:0:6680:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 386 last 0 00000020:00000080:2.0:1788744313.901409:0:6680:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b94964 00002000:00100000:2.0:1788744313.902250:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03c88f08-96bd-4666-9af8-74d11f561443/ffff940ac2d3f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744313.902277:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744313.902533:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744313.902591:0:6680:0:(import.c:65:import_set_state_nolock()) ffff940ac2d38800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744313.902666:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047446912:12345-192.168.204.56@tcp:8:bash.0 Request processed in 1355us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744313.902691:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00010000:00010000:3.0:1788744313.905348:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905396:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905405:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905411:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744313.905417:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905425:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905448:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc200) 00010000:00010000:3.0:1788744313.905451:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744313.905457:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744313.905463:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b9494f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744313.911100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.911273:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047447040 00000100:00100000:2.0:1788744313.911295:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047447040 00000100:00100000:2.0:1788744313.911386:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744313.911397:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:0:x1875634047447040:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744313.911423:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744313.911454:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611b3 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744313.911491:0:8624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744313.911513:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788744313.911518:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744313.911530:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 7 pid: 8624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.911590:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 7 pid: 8624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.911608:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388400, rc 0) 00000100:00100000:2.0:1788744313.911678:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:0:x1875634047447040:12345-192.168.204.56@tcp:101:bash.0 Request processed in 282us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744313.911686:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00080000:0.0:1788744313.911750:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744313.916393:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.916595:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047447168 00000100:00100000:2.0:1788744313.916605:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047447168 00000100:00100000:2.0:1788744313.916652:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:2.0:1788744313.916663:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:10293:x1875634047447168:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744313.916688:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744313.916707:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611ba expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.916743:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.916753:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744313.916758:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744313.916763:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.916801:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.916815:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744313.916830:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875634068456320:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744313.916929:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b009456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744313.919517:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744313.919649:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875634068456320:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744313.919684:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744313.919705:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744313.919791:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:10293:x1875634047447168:12345-192.168.204.56@tcp:101:bash.0 Request processed in 3129us (3408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744313.919801:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:1.0:1788744313.920844:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047447296 00000100:00100000:1.0:1788744313.920856:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047447296 00010000:00010000:0.0:1788744313.920978:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744313.921026:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:0.0:1788744313.921047:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047447296:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744313.921063:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744313.921089:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744313.921119:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744313.921145:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b9496b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611b3 expref: 8 pid: 8624 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744313.921163:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744313.921167:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744313.921175:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744313.921196:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744313.921232:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744313.921247:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068456448:192.168.204.56@tcp:105: 00000100:00100000:0.0:1788744313.921342:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744313.926346:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068456448:192.168.204.56@tcp:105: 00010000:00010000:2.0:1788744313.926374:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744313.926428:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047447296:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 5382us (6920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744313.926439:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:3.0:1788744313.926661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744313.926871:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047447552 00000100:00100000:0.0:1788744313.926881:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047447552 00000100:00100000:0.0:1788744313.926923:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:0.0:1788744313.926934:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+12:10293:x1875634047447552:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:0.0:1788744313.927325:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10293:x1875634047447552:12345-192.168.204.56@tcp:35:bash.0 Request processed in 392us (664us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788744313.927348:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:3.0:1788744314.062592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.062766:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047447808 00000100:00100000:2.0:1788744314.062776:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047447808 00000100:00100000:2.0:1788744314.062848:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:2.0:1788744314.062859:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+13:10303:x1875634047447808:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744314.062887:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744314.062911:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94979 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611c1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744314.063037:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744314.063172:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94979 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611c1 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.063200:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:2.0:1788744314.063203:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744314.063208:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94979 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611c1 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.063225:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744314.063296:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+14:10303:x1875634047447808:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 439us (758us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788744314.063316:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:1.0:1788744314.066921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744314.067083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448064 00000100:00100000:0.0:1788744314.067096:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448064 00000100:00100000:0.0:1788744314.067172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:0.0:1788744314.067194:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:10303:x1875634047448064:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:0.0:1788744314.067467:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+15:10303:x1875634047448064:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 275us (556us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788744314.067475:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:3.0:1788744314.234685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.234906:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448192 00000100:00100000:2.0:1788744314.234917:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448192 00000100:00100000:2.0:1788744314.234980:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:2.0:1788744314.234991:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+15:10309:x1875634047448192:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744314.235018:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744314.235050:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611c8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235121:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235136:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235150:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744314.235197:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788744314.235202:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744314.235223:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235248:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611c8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235270:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611c8 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.235670:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744314.235673:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744314.235677:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389000, rc 0) 00000100:00100000:2.0:1788744314.235886:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+16:10309:x1875634047448192:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 895us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.235893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:3.0:1788744314.251294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.255692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448448 00000100:00100000:2.0:1788744314.255710:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448448 00000100:00100000:2.0:1788744314.256719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:2.0:1788744314.256743:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+16:10309:x1875634047448448:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744314.256766:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744314.256787:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611cf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.256891:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9499c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.256907:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9499c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.256920:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9499c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744314.256933:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744314.257076:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611cf expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.257121:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9499c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611cf expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.257129:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744314.257132:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744314.257136:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389800, rc 0) 00000100:00100000:2.0:1788744314.257225:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+18:10309:x1875634047448448:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 494us (5953us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788744314.257232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:0.0:1788744314.260422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744314.267529:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448704 00000100:00100000:1.0:1788744314.267546:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448704 00000100:00100000:1.0:1788744314.267641:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:1.0:1788744314.267654:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+18:10309:x1875634047448704:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744314.267686:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744314.267712:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b949aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611d6 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.267837:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.267853:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.267866:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744314.267879:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788744314.268011:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b949aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611d6 expref: 21 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.268044:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611d6 expref: 20 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.268054:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:1.0:1788744314.268057:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744314.268062:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3e00, rc 0) 00000100:00100000:1.0:1788744314.268154:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+20:10309:x1875634047448704:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 502us (7741us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788744314.268163:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:0.0:1788744314.270267:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.271108:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448832 00000100:00100000:2.0:1788744314.271120:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448832 00000100:00100000:2.0:1788744314.271180:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744314.271191:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+20:2353:x1875634047448832:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744314.271207:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744314.271232:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9499c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611cf expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.271252:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744314.271257:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744314.271343:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+19:2353:x1875634047448832:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 152us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.271351:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:1.0:1788744314.279882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.279998:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047448960 00000100:00100000:2.0:1788744314.280008:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047448960 00000100:00100000:2.0:1788744314.280079:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:2.0:1788744314.280106:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047448960:12345-192.168.204.56@tcp:1:lfs.0 00010000:00010000:2.0:1788744314.280158:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.280182:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.280192:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744314.280197:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744314.280202:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.280245:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.280259:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 7 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744314.280274:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8624:1875634068456576:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744314.280954:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b009456c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744314.288733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.289006:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449088 00000100:00100000:2.0:1788744314.289016:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449088 00002000:00100000:2.0:1788744314.289072:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff940ad31e5c00 x1875634047449088/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:590/0 lens 504/0 e 0 to 0 dl 1788744325 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744314.289083:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ad31e5c00 with x1875634047449088 ext(0->12) 00010000:00010000:2.0:1788744314.289094:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 8 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.289142:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 8 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744314.289150:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940ad31e5c00 00000100:00100000:2.0:1788744314.289275:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:2.0:1788744314.289286:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047449088:12345-192.168.204.56@tcp:4:lfs.0 00000100:00100000:0.0:1788744314.290573:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8624:1875634068456576:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744314.290605:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788744314.410590:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000100:00100000:1.0:1788744314.412190:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047449088:12345-192.168.204.56@tcp:4:lfs.0 Request processed in 122886us (123446us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788744314.412211:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00002000:00100000:1.0:1788744314.412227:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff940ad31e5c00 x1875634047449088/t4294967299(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:590/0 lens 504/448 e 0 to 0 dl 1788744325 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744314.412239:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ad31e5c00 with x1875634047449088 ext(0->12) 00010000:00010000:1.0:1788744314.412250:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.412272:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744314.412290:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940ad31e5c00 00000100:00100000:0.0:1788744314.417596:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.418016:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449216 00000100:00100000:2.0:1788744314.418048:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449216 00010000:00010000:2.0:1788744314.418098:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744314.418160:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:2.0:1788744314.418183:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2351:x1875634047449216:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744314.418202:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788744314.418225:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788744314.418229:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788744313 00002000:00010000:2.0:1788744314.418231:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788744314 00002000:00010000:2.0:1788744314.418233:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788744313 00010000:00010000:2.0:1788744314.418239:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.418254:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.418297:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b94972 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ba expref: 9 pid: 6680 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.418319:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744314.418325:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744314.418332:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.418342:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.418388:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744314.418454:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2351:x1875634047449216:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 284us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.418462:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 36 00010000:00010000:1.0:1788744314.419060:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419074:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419106:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419130:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419139:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419147:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744314.419152:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419162:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419195:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.419204:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b949bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744314.419303:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047448960:12345-192.168.204.56@tcp:1:lfs.0 Request processed in 139198us (139429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744314.419311:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:0.0:1788744314.423684:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744314.423965:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449472 00000100:00100000:3.0:1788744314.423978:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449472 00000100:00100000:3.0:1788744314.424040:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744314.424051:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+19:10309:x1875634047449472:12345-192.168.204.56@tcp:35:lfs.0 00000004:00010000:3.0:1788744314.424138:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611d6 expref: 19 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744314.424697:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788744314.424833:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788744314.426668:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788744314.439168:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.439201:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.439211:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.439260:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.439307:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 23 pid: 5837 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744314.439323:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068456704:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744314.439718:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744314.442153:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068456704:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744314.442187:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744314.444151:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.444266:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449600 00000100:00100000:2.0:1788744314.444277:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449600 00010000:00010000:2.0:1788744314.444334:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 24 pid: 5837 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744314.444580:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:0.0:1788744314.444606:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+24:2354:x1875634047449600:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744314.444626:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744314.444634:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 24 pid: 5837 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446586:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 24 pid: 5837 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446630:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611ac expref: 24 pid: 5837 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446658:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:0.0:1788744314.446664:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446675:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446683:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744314.446802:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744314.446906:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+23:2354:x1875634047449600:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 2301us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744314.446918:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 37 00010000:00010000:2.0:1788744314.447069:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.447078:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744314.448011:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788744314.449008:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788744314.449199:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068456832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744314.449630:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744314.449681:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744314.449800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068456832 00000100:00100000:3.0:1788744314.449810:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068456832 00000100:00100000:3.0:1788744314.449920:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744314.449930:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068456832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744314.450041:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068456832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744314.450050:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744314.450200:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068456832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744314.450941:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788744314.451029:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8175880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068456960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744314.451077:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744314.451106:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b009450c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744314.451251:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068456960 00000100:00100000:3.0:1788744314.451258:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068456960 00000100:00100000:3.0:1788744314.451298:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744314.451307:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068456960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744314.451478:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875634068456960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 171us (399us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788744314.451486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744314.452514:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8175880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068456960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744314.452625:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788744314.452679:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452690:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452697:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452703:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744314.452708:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452715:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452732:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744314.452735:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788744314.452740:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.452746:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744314.452932:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788744314.453520:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788744314.453533:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386585983425ns, next at 387585981025ns, rc = 0 00000001:00080000:2.0:1788744314.453542:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788744314.453609:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744314.453613:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744314.453633:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b949b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611d6 expref: 27 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744314.453828:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+26:10309:x1875634047449472:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 29778us (30157us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788744314.453838:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000020:00080000:2.0:1788744314.453846:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788744314.453955:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744314.458029:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.458098:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449728 00000100:00100000:2.0:1788744314.458112:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449728 00000100:00100000:2.0:1788744314.458193:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:2.0:1788744314.458205:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+26:10309:x1875634047449728:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744314.458234:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744314.458258:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b949cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611dd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.458327:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b949cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611dd expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.458342:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b949cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611dd expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.458360:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744314.458363:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744314.458367:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744314.458641:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+27:10309:x1875634047449728:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 438us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744314.458649:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:3.0:1788744314.462970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744314.463089:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047449984 00000100:00100000:0.0:1788744314.463101:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047449984 00000100:00100000:0.0:1788744314.463222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:0.0:1788744314.463233:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad86d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+27:10309:x1875634047449984:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:0.0:1788744314.463512:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad86d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:10309:x1875634047449984:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 280us (551us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788744314.463520:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:3.0:1788744314.581535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744314.581870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047450240 00000100:00100000:1.0:1788744314.581882:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047450240 00000100:00100000:1.0:1788744314.581954:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744314.581972:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:10319:x1875634047450240:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744314.581997:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744314.582030:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b949d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611e4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744314.582135:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788744314.582269:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b949d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611e4 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.582284:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:1.0:1788744314.582287:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744314.582293:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b949d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611e4 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744314.582308:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3a00, rc 0) 00000100:00100000:1.0:1788744314.582963:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+29:10319:x1875634047450240:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 990us (1438us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1788744314.582972:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744314.586670:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:1.0:1788744314.586941:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744314.587135:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047450368 00000100:00100000:3.0:1788744314.587146:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047450368 00000100:00100000:3.0:1788744314.587215:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:3.0:1788744314.587225:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+29:10319:x1875634047450368:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:3.0:1788744314.587304:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587332:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587343:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587362:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587466:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587475:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587592:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587601:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587608:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744314.587652:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587663:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587670:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587686:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587692:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744314.587697:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587705:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.587997:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744314.588001:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744314.588007:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588023:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b949e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588037:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588042:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588047:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588052:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744314.588054:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588070:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588078:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818700) 00010000:00010000:3.0:1788744314.588080:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744314.588083:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588089:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b949e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588115:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588122:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588127:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588131:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744314.588134:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588139:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588145:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744314.588147:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744314.588150:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.588165:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b949f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744314.588286:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+29:10319:x1875634047450368:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1060us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744314.588295:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:1.0:1788744314.596008:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.596252:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047450624 00000100:00100000:2.0:1788744314.596347:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047450624 00000100:00100000:2.0:1788744314.596541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:2.0:1788744314.596587:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+29:10319:x1875634047450624:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744314.596892:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+30:10319:x1875634047450624:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 340us (893us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788744314.596900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:1.0:1788744314.657249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744314.657373:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047450880 00000100:00100000:2.0:1788744314.657385:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047450880 00000100:00100000:2.0:1788744314.657457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:2.0:1788744314.657467:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+30:10322:x1875634047450880:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744314.657497:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744314.657524:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657646:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657662:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657673:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657688:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657695:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657701:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657920:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657930:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.657938:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744314.657948:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788744314.658077:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658086:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658093:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658100:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744314.658105:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658113:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658126:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744314.658129:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744314.658136:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658154:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b949fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658169:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658174:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658180:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658184:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744314.658187:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658193:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658201:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc400) 00010000:00010000:2.0:1788744314.658203:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744314.658206:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658211:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658253:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b949f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658267:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744314.658280:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744314.658282:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744314.658284:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388600, rc 0) 00000100:00100000:2.0:1788744314.658343:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+32:10322:x1875634047450880:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 877us (1106us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788744314.658350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:1.0:1788744314.664447:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744314.664597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047451008 00000100:00100000:3.0:1788744314.664609:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047451008 00000100:00100000:3.0:1788744314.664673:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:3.0:1788744314.664683:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:10322:x1875634047451008:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:3.0:1788744314.664775:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664793:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664805:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664835:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664843:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664850:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664856:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744314.664860:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664877:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664889:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744314.664892:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744314.664897:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744314.664902:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744314.664988:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:10322:x1875634047451008:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 306us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744314.664995:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:1.0:1788744314.669411:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744314.669653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047451264 00000100:00100000:0.0:1788744314.669664:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047451264 00000100:00100000:0.0:1788744314.669734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744314.669746:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:10322:x1875634047451264:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:0.0:1788744314.670061:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+33:10322:x1875634047451264:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 317us (661us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788744314.670069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744314.906915:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068457088:0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.906992:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744314.907061:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068457600:0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.907086:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744314.907110:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744314.907115:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068457472:0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.907138:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744314.907187:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457472 00000100:00100000:0.0:1788744314.907197:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457472 00000100:00100000:0.0:1788744314.907252:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744314.907261:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068457472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.907352:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068457472:12345-0@lo:400:kworker.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744314.907370:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788744314.907392:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744314.907434:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068457472:0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.907628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457088 00000100:00100000:1.0:1788744314.907634:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457088 00000100:00100000:1.0:1788744314.907670:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788744314.907677:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068457088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.907727:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068457088:12345-0@lo:400:kworker.0 Request processed in 50us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744314.907733:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788744314.908342:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068457088:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.908516:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068457216:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.908616:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744314.908640:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068457728:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.908662:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744314.908685:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744314.908691:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068457344:0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.908824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457600 00000100:00100000:1.0:1788744314.908830:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457600 00000100:00100000:1.0:1788744314.908870:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457216 00000100:00100000:1.0:1788744314.908873:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457216 00000100:00100000:1.0:1788744314.908895:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788744314.908904:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068457600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.908948:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068457600:12345-0@lo:400:kworker.0 Request processed in 45us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744314.908954:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788744314.908970:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788744314.908975:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068457216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.909002:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068457216:12345-0@lo:400:kworker.0 Request processed in 28us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744314.909019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788744314.909053:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457728 00000100:00100000:1.0:1788744314.909057:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457728 00000100:00100000:1.0:1788744314.909081:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744314.909088:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068457728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744314.909118:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068457728:12345-0@lo:400:kworker.0 Request processed in 31us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744314.909124:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788744314.909388:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744314.909426:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068457216:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.909437:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00942300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068457728:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.909662:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744314.909670:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068457856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744314.909700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744314.909871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457344 00000100:00100000:0.0:1788744314.909877:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457344 00000100:00100000:0.0:1788744314.909911:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788744314.909918:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068457344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.909955:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068457344:12345-0@lo:400:kworker.0 Request processed in 38us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744314.909962:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788744314.909978:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744314.909999:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068457600:0@lo:400:kworker.0 00000100:00100000:3.0:1788744314.910257:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00940000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068457344:0@lo:400:kworker.0 00000100:00100000:0.0:1788744314.910423:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068457856 00000100:00100000:0.0:1788744314.910428:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068457856 00000100:00100000:0.0:1788744314.910468:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788744314.910476:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068457856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744314.910495:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744314.910543:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace306850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068457856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744314.910577:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788744314.912413:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068457856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744315.155703:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744315.155808:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047451520 00000100:00100000:1.0:1788744315.155819:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047451520 00000100:00100000:1.0:1788744315.155905:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:1.0:1788744315.155933:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+33:10353:x1875634047451520:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:1.0:1788744315.155967:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744315.155990:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611f2 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744315.156115:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b94a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744315.156129:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b94a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744315.156142:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b94a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744315.156164:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788744315.156627:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f2 expref: 36 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744315.156649:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b94a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f2 expref: 35 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744315.156658:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744315.156661:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744315.156665:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3000, rc 0) 00000100:00100000:1.0:1788744315.156761:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+35:10353:x1875634047451520:12345-192.168.204.56@tcp:101:cat.0 Request processed in 831us (1067us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788744315.156769:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00080000:0.0:1788744315.157185:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744315.164317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744315.164517:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047451776 00000100:00100000:0.0:1788744315.164527:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047451776 00000100:00100000:0.0:1788744315.164634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:0.0:1788744315.164645:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+35:10353:x1875634047451776:12345-192.168.204.56@tcp:35:cat.0 00000100:00100000:0.0:1788744315.164938:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+36:10353:x1875634047451776:12345-192.168.204.56@tcp:35:cat.0 Request processed in 294us (632us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788744315.164946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744315.171786:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744315.171869:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047451904 00000100:00100000:0.0:1788744315.171882:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047451904 00000100:00100000:0.0:1788744315.171951:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:0.0:1788744315.171961:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+36:2354:x1875634047451904:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744315.171979:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744315.172015:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b94a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f2 expref: 36 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.172034:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744315.172039:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744315.172114:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+35:2354:x1875634047451904:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 148us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744315.172123:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:1.0:1788744315.249359:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744315.249511:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047452160 00000100:00100000:0.0:1788744315.249521:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047452160 00000100:00100000:0.0:1788744315.249708:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:0.0:1788744315.249778:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:10359:x1875634047452160:12345-192.168.204.56@tcp:101:dd.0 00010000:00010000:0.0:1788744315.249804:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744315.249807:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788744315.249838:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b9498e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611c8 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.249872:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:0.0:1788744315.249877:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744315.249892:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94a36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57611f9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.249999:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.250025:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.250034:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.250066:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.250079:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 35 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744315.250266:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068457984:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744315.250419:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744315.254393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744315.254499:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068457984:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744315.254527:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744315.254659:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047452288 00000100:00100000:2.0:1788744315.254667:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047452288 00010000:00010000:2.0:1788744315.254704:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 36 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744315.254787:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:2.0:1788744315.254798:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+36:2354:x1875634047452288:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744315.254814:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744315.254820:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 36 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254832:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 36 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254857:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611eb expref: 36 pid: 5838 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254872:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744315.254889:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254898:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254906:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.254939:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744315.254992:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+35:2354:x1875634047452288:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 196us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744315.255000:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00010000:00010000:3.0:1788744315.255070:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.255079:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744315.255110:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788744315.255311:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94a36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.255331:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.255339:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744315.255341:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744315.255344:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296800, rc 0) 00000100:00100000:3.0:1788744315.255374:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:10359:x1875634047452160:12345-192.168.204.56@tcp:101:dd.0 Request processed in 5600us (6028us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788744315.255381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:1.0:1788744315.258590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744315.258661:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047452544 00000100:00100000:3.0:1788744315.258673:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047452544 00000100:00100000:3.0:1788744315.258737:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:3.0:1788744315.258747:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+35:10359:x1875634047452544:12345-192.168.204.56@tcp:36:dd.0 00010000:00010000:3.0:1788744315.259026:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.259060:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.259073:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744315.259133:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788744315.259166:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000dcd840ce reply state 000000004fbdb5b2 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744315.259175:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744315.259257:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+38:10359:x1875634047452544:12345-192.168.204.56@tcp:36:dd.0 Request processed in 510us (714us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788744315.259264:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 52 00000020:00080000:3.0:1788744315.259269:0:10823:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788744315.261133:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261172:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261181:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261186:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744315.261191:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261198:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261214:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744315.261217:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744315.261222:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744315.261228:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.613022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744315.801367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744315.801596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047452672 00000100:00100000:3.0:1788744315.801608:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047452672 00000100:00100000:3.0:1788744315.801673:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:3.0:1788744315.801685:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+37:10374:x1875634047452672:12345-192.168.204.56@tcp:101:stat.0 00010000:00010000:3.0:1788744315.801711:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744315.801734:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761200 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801811:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801827:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801839:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801873:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801880:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.801898:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.802013:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.802025:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.802032:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.802068:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.802155:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 38 pid: 5837 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744315.802170:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068458112:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744315.804729:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744315.822210:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068458112:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744315.822243:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744315.833480:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744315.841967:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047452928 00000100:00100000:0.0:1788744315.841986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047452928 00000100:00100000:0.0:1788744315.842098:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:0.0:1788744315.842111:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+39:5592:x1875634047452928:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788744315.843452:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+40:5592:x1875634047452928:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 1338us (9980us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788744315.843462:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:0.0:1788744315.869706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744315.870185:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453056 00000100:00100000:2.0:1788744315.870197:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453056 00010000:00010000:2.0:1788744315.870238:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 40 pid: 5837 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744315.870281:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:2.0:1788744315.870292:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+40:2353:x1875634047453056:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744315.870320:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744315.870327:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 40 pid: 5837 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870342:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 40 pid: 5837 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870367:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611f9 expref: 40 pid: 5837 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870390:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744315.870395:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870403:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870411:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744315.870442:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744315.870501:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+39:2353:x1875634047453056:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 211us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744315.870508:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 39 00010000:00010000:3.0:1788744315.871615:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871628:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744315.871677:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788744315.871681:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744315.871727:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871742:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871750:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871757:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871764:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871770:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744315.871773:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871781:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871805:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744315.871817:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744315.871822:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94a59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871843:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871855:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871861:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871866:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744315.871868:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871874:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871881:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818700) 00010000:00010000:3.0:1788744315.871884:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744315.871886:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871892:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871936:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761200 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871962:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761200 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744315.871970:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744315.871973:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744315.871975:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031a00, rc 0) 00000100:00100000:3.0:1788744315.872037:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+38:10374:x1875634047452672:12345-192.168.204.56@tcp:101:stat.0 Request processed in 70353us (70681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744315.872045:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:2.0:1788744315.930910:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068458240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744315.931002:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744315.931628:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068458240 00000100:00100000:1.0:1788744315.931638:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068458240 00000100:00100000:1.0:1788744315.931687:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744315.931695:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068458240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744315.931731:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744315.931851:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068458240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744315.931858:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744315.932592:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068458240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744316.018211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744316.018490:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453312 00000100:00100000:3.0:1788744316.018500:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453312 00000100:00100000:3.0:1788744316.018591:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:3.0:1788744316.018603:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+38:10380:x1875634047453312:12345-192.168.204.56@tcp:36:truncate.0 00010000:00010000:3.0:1788744316.018685:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744316.018714:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761200 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.018733:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744316.018738:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744316.018959:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.018974:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.018985:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744316.019058:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788744316.019082:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f99c2a02 reply state 00000000b169d53a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744316.019091:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744316.021646:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+40:10380:x1875634047453312:12345-192.168.204.56@tcp:36:truncate.0 Request processed in 3035us (3437us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788744316.021659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 54 00000020:00080000:3.0:1788744316.021665:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744316.040180:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040201:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040209:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040217:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744316.040222:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040231:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040264:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744316.040267:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744316.040273:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.040280:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94a6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744316.251219:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788744316.281871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744316.281998:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453440 00000100:00100000:1.0:1788744316.282010:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453440 00000100:00100000:1.0:1788744316.282083:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:1.0:1788744316.282095:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+39:10394:x1875634047453440:12345-192.168.204.56@tcp:101:stat.0 00010000:00010000:1.0:1788744316.282122:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744316.282158:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761207 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282240:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282279:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282293:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282624:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282633:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282640:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282739:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282748:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282757:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744316.282796:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788744316.282802:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744316.282828:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282843:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282852:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282860:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282877:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282884:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744316.282888:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282897:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282911:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:1.0:1788744316.282915:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744316.282921:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282928:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282945:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282952:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282959:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282965:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744316.282968:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.282997:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.283007:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac3570700) 00010000:00010000:1.0:1788744316.283010:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744316.283013:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.283020:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.283057:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 41 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.283074:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 40 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.283081:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744316.283084:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744316.283086:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2800, rc 0) 00000100:00100000:1.0:1788744316.283166:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+40:10394:x1875634047453440:12345-192.168.204.56@tcp:101:stat.0 Request processed in 1072us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744316.283174:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:0.0:1788744316.394907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.395008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.395048:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.395087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.395122:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453696 00000100:00100000:0.0:1788744316.395134:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453696 00000100:00100000:0.0:1788744316.395196:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453952 00000100:00100000:0.0:1788744316.395199:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453952 00000100:00100000:0.0:1788744316.395236:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 152 00000100:00100000:0.0:1788744316.395266:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+40:2352:x1875634047453696:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744316.395359:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+40:2352:x1875634047453696:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 104us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744316.395367:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 152 00000100:00100000:0.0:1788744316.395388:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 153 00000100:00100000:0.0:1788744316.395395:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047453952:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744316.395420:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047453952:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744316.395426:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 153 00000100:00080000:0.0:1788744316.395441:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744316.399360:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453824 00000100:00100000:1.0:1788744316.399377:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453824 00000100:00100000:1.0:1788744316.399475:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:1.0:1788744316.399487:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047453824:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744316.399642:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047453824:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 157us (4633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744316.399652:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00080000:2.0:1788744316.401033:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744316.407183:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047453568 00000100:00100000:3.0:1788744316.407206:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047453568 00000100:00100000:3.0:1788744316.407340:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 296 00000100:00100000:3.0:1788744316.407352:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047453568:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744316.407450:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047453568:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 99us (12553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744316.407458:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 296 00000100:00100000:0.0:1788744316.436845:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744316.436970:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047454208 00000100:00100000:1.0:1788744316.436997:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047454208 00000100:00100000:1.0:1788744316.437084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:1.0:1788744316.437097:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+40:10404:x1875634047454208:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744316.437124:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744316.437157:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576120e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744316.437290:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788744316.437455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94a91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576120e expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.437472:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:1.0:1788744316.437475:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744316.437480:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576120e expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.437500:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2000, rc 0) 00000100:00100000:1.0:1788744316.437644:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+41:10404:x1875634047454208:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 550us (810us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788744316.437652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:0.0:1788744316.441385:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744316.441484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047454464 00000100:00100000:3.0:1788744316.441495:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047454464 00000100:00100000:3.0:1788744316.441599:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:3.0:1788744316.441609:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+41:10404:x1875634047454464:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744316.441880:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+42:10404:x1875634047454464:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 272us (506us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788744316.441888:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:3.0:1788744316.548717:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.549072:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047454720 00000100:00100000:0.0:1788744316.549084:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047454720 00000100:00100000:0.0:1788744316.549173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:0.0:1788744316.549184:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+42:10410:x1875634047454720:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744316.549227:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744316.549249:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94a9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761215 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.549697:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.549715:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 43 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.549724:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.549761:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 43 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.549783:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 43 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744316.549797:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068458368:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744316.549948:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744316.556630:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.557633:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068458368:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744316.557663:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744316.558172:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047454848 00000100:00100000:2.0:1788744316.558180:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047454848 00010000:00010000:2.0:1788744316.558222:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 44 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744316.558270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:2.0:1788744316.558279:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+44:2354:x1875634047454848:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744316.558293:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744316.558311:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 44 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558323:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 44 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558345:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761207 expref: 44 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558361:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744316.558366:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558376:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558383:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.558407:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744316.558456:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+43:2354:x1875634047454848:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 179us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744316.558469:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00010000:00010000:3.0:1788744316.559015:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.559028:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744316.559050:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788744316.559214:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94a9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.559244:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.559251:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744316.559254:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788744316.559257:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:3.0:1788744316.559368:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+43:10410:x1875634047454720:12345-192.168.204.56@tcp:101:bash.0 Request processed in 10186us (10661us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788744316.559375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744316.568360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744316.568592:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047455104 00000100:00100000:2.0:1788744316.568604:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047455104 00000100:00100000:2.0:1788744316.568665:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:2.0:1788744316.568675:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+43:10410:x1875634047455104:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:2.0:1788744316.568992:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.569019:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.569032:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744316.569083:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788744316.569105:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000042bb1296 reply state 00000000e0ba0b09 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744316.569113:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744316.569223:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+46:10410:x1875634047455104:12345-192.168.204.56@tcp:36:bash.0 Request processed in 549us (873us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788744316.569230:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 58 00000020:00080000:2.0:1788744316.569235:0:6704:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788744316.574774:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574792:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574800:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574807:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744316.574812:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574820:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574839:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744316.574841:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744316.574846:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.574852:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94ab4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744316.581949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.582090:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047455232 00000100:00100000:0.0:1788744316.582100:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047455232 00000100:00100000:0.0:1788744316.582168:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:0.0:1788744316.582194:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+45:10410:x1875634047455232:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744316.582230:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744316.582256:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576121c expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.582378:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.582396:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.582405:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.582442:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.582457:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 46 pid: 5837 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744316.582472:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068458496:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744316.582611:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744316.592635:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068458496:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744316.592665:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744316.593668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744316.593750:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047455360 00000100:00100000:2.0:1788744316.593760:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047455360 00010000:00010000:2.0:1788744316.593800:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 47 pid: 5837 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744316.593841:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:2.0:1788744316.593851:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+47:2353:x1875634047455360:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744316.593866:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744316.593872:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 47 pid: 5837 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.593885:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 47 pid: 5837 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.593929:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94aa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761215 expref: 47 pid: 5837 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.593948:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744316.593953:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.593962:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.593970:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.594009:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744316.594111:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+46:2353:x1875634047455360:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 260us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744316.594118:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 41 00010000:00010000:1.0:1788744316.594271:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.594303:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744316.594359:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788744316.594363:0:10823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744316.594386:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.594416:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576121c expref: 46 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.594431:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576121c expref: 45 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.594438:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744316.594440:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744316.594442:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297400, rc 0) 00000100:00100000:1.0:1788744316.594467:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+45:10410:x1875634047455232:12345-192.168.204.56@tcp:101:bash.0 Request processed in 12276us (12530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744316.594475:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:0.0:1788744316.606262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744316.606637:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047455616 00000100:00100000:3.0:1788744316.606648:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047455616 00000100:00100000:3.0:1788744316.606708:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:3.0:1788744316.606718:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad86d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+45:10410:x1875634047455616:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:3.0:1788744316.606957:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad86d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+46:10410:x1875634047455616:12345-192.168.204.56@tcp:35:bash.0 Request processed in 239us (704us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788744316.606964:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00010000:00010000:1.0:1788744316.634914:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744316.696627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.696785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047455872 00000100:00100000:0.0:1788744316.696798:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047455872 00000100:00100000:0.0:1788744316.696865:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:0.0:1788744316.696876:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+46:10420:x1875634047455872:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744316.696904:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744316.696942:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761223 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744316.697053:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788744316.697177:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ac9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761223 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.697191:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:0.0:1788744316.697195:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744316.697204:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761223 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.697218:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296e00, rc 0) 00000100:00100000:0.0:1788744316.697426:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+47:10420:x1875634047455872:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 550us (812us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788744316.697434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:1.0:1788744316.702725:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744316.703710:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047456000 00000100:00100000:0.0:1788744316.703726:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047456000 00000100:00100000:0.0:1788744316.703795:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:0.0:1788744316.703806:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+47:10420:x1875634047456000:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:0.0:1788744316.703888:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.703906:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.703918:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.703952:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.703959:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.703965:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704072:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704082:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704089:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744316.704134:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704147:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704154:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704161:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704167:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744316.704171:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704186:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704197:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:0.0:1788744316.704200:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744316.704205:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704211:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704224:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704231:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704237:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704241:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744316.704244:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.704250:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705404:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad90afe00) 00010000:00010000:0.0:1788744316.705408:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744316.705414:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705437:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705463:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705469:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705476:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705481:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744316.705485:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705490:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705499:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744316.705501:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744316.705505:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744316.705510:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744316.705644:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+47:10420:x1875634047456000:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1837us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744316.705654:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:3.0:1788744316.709930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744316.710047:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047456256 00000100:00100000:2.0:1788744316.710059:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047456256 00000100:00100000:2.0:1788744316.710123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:2.0:1788744316.710135:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+47:10420:x1875634047456256:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744316.710635:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+48:10420:x1875634047456256:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 501us (718us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788744316.710645:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:3.0:1788744316.808995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744316.809114:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047456512 00000100:00100000:1.0:1788744316.809125:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047456512 00000100:00100000:1.0:1788744316.809197:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:1.0:1788744316.809209:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+48:10423:x1875634047456512:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744316.809236:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744316.809286:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576122a expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809369:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809384:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809396:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809410:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809417:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809424:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809593:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809602:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809609:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744316.809621:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788744316.809725:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809742:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809749:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809755:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744316.809760:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809768:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809780:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:1.0:1788744316.809783:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744316.809787:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809793:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809808:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809814:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809821:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809826:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744316.809832:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809839:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809846:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac3570700) 00010000:00010000:1.0:1788744316.809849:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744316.809851:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809856:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809896:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576122a expref: 51 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809911:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576122a expref: 50 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744316.809918:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744316.809920:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744316.809923:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2800, rc 0) 00000100:00100000:1.0:1788744316.809991:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+50:10423:x1875634047456512:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 784us (1022us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788744316.809998:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:1.0:1788744316.826154:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744316.826460:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047456640 00000100:00100000:2.0:1788744316.826472:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047456640 00000100:00100000:2.0:1788744316.826541:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:2.0:1788744316.826619:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+50:2351:x1875634047456640:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744316.826637:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744316.826666:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576122a expref: 50 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744316.826688:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744316.826693:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744316.826768:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+49:2351:x1875634047456640:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 150us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744316.826783:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:0.0:1788744316.846061:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744316.847040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047456768 00000100:00100000:3.0:1788744316.847052:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047456768 00000100:00100000:3.0:1788744316.847136:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:3.0:1788744316.847147:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+49:10423:x1875634047456768:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:3.0:1788744316.847220:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847264:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847279:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847308:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847315:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847322:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847328:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744316.847333:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847340:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847352:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744316.847355:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744316.847361:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744316.847367:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744316.847452:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+49:10423:x1875634047456768:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 306us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744316.847467:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:3.0:1788744316.854443:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744316.854590:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047457024 00000100:00100000:2.0:1788744316.854601:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047457024 00000100:00100000:2.0:1788744316.854648:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:2.0:1788744316.854658:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+49:10423:x1875634047457024:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744316.854921:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+50:10423:x1875634047457024:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 262us (486us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788744316.854929:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:1.0:1788744317.095336:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744317.095433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047457280 00000100:00100000:0.0:1788744317.095443:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047457280 00000100:00100000:0.0:1788744317.095529:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:0.0:1788744317.095582:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+50:10441:x1875634047457280:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:0.0:1788744317.095610:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744317.095633:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761231 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.095739:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94b1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.095756:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.095770:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744317.095782:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788744317.095930:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761231 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.095948:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761231 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.095958:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744317.095961:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788744317.095964:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296800, rc 0) 00000100:00100000:0.0:1788744317.096040:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+52:10441:x1875634047457280:12345-192.168.204.56@tcp:101:cat.0 Request processed in 494us (714us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788744317.096065:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00080000:2.0:1788744317.099494:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744317.137154:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.137330:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047457408 00000100:00100000:2.0:1788744317.137342:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047457408 00000100:00100000:2.0:1788744317.137411:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:2.0:1788744317.137421:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+52:10442:x1875634047457408:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744317.137448:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744317.137470:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761238 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137637:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137654:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137667:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744317.137705:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788744317.137709:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744317.137728:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137759:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761238 expref: 54 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137779:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761238 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.137788:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744317.137791:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744317.137795:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389400, rc 0) 00000100:00100000:2.0:1788744317.137853:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+53:10442:x1875634047457408:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 432us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.137860:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:3.0:1788744317.162268:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.166216:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047457792 00000100:00100000:2.0:1788744317.166234:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047457792 00000100:00100000:2.0:1788744317.166324:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744317.166336:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+53:10442:x1875634047457792:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744317.166960:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+54:10442:x1875634047457792:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 624us (4700us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788744317.166982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:0.0:1788744317.170072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.170408:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047457920 00000100:00100000:2.0:1788744317.170418:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047457920 00000100:00100000:2.0:1788744317.170482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:2.0:1788744317.170493:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+54:10442:x1875634047457920:12345-192.168.204.56@tcp:103:lfs.0 00010000:00010000:2.0:1788744317.170514:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788744317.170579:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576121c expref: 54 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.170603:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761231 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.170614:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b949cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611dd expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.170624:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744317.170634:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744317.171191:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+51:10442:x1875634047457920:12345-192.168.204.56@tcp:103:lfs.0 Request processed in 697us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.171201:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:3.0:1788744317.185885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.186101:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458048 00000100:00100000:1.0:1788744317.186141:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458048 00000100:00100000:1.0:1788744317.186216:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:1.0:1788744317.186227:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+51:10442:x1875634047458048:12345-192.168.204.56@tcp:58:lfs.0 00010000:00010000:1.0:1788744317.186382:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.186401:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.186415:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744317.187787:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744317.199699:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788744317.199802:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788744317.199956:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+51:10442:x1875634047458048:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 13723us (14087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.199981:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:3.0:1788744317.238372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.238692:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458176 00000100:00100000:1.0:1788744317.238703:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458176 00000100:00100000:1.0:1788744317.238778:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 67 00000100:00100000:1.0:1788744317.238790:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+51:10444:x1875634047458176:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744317.238811:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744317.238837:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576123f expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.238920:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.238936:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.238976:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.238993:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239000:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239007:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239110:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239307:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239317:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744317.239370:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788744317.239375:0:10823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744317.239394:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239405:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239412:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239430:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239436:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239443:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.239447:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239454:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239467:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:1.0:1788744317.239470:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744317.239477:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239483:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239498:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239504:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239509:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239514:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.239523:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239530:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239778:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac3570d00) 00010000:00010000:1.0:1788744317.239781:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744317.239784:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239790:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239830:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 53 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239846:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 52 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.239853:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:1.0:1788744317.239856:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744317.239858:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3a00, rc 0) 00000100:00100000:1.0:1788744317.239976:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+52:10444:x1875634047458176:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1177us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.239984:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 67 00000040:00080000:3.0:1788744317.275164:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744317.275180:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744317.275253:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788744317.275264:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744317.275430:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d03800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068458624:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744317.275594:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744317.282923:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d03800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068458624:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744317.287445:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.287763:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458304 00000100:00100000:2.0:1788744317.287806:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458304 00000100:00100000:2.0:1788744317.287880:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744317.287892:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458304:12345-192.168.204.56@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788744317.288048:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458304:12345-192.168.204.56@tcp:900:lhsmtool_posix.0 Request processed in 157us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.288066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:3.0:1788744317.300027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.301714:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458432 00000100:00100000:1.0:1788744317.301737:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458432 00000100:00100000:1.0:1788744317.301811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 68 00000100:00100000:1.0:1788744317.301824:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458432:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744317.301877:0:5837:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744317.302049:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458432:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 226us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.302058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 68 00000100:00100000:0.0:1788744317.324312:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.324410:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458560 00000100:00100000:1.0:1788744317.324420:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458560 00000100:00100000:1.0:1788744317.324487:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:1.0:1788744317.324499:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458560:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788744317.324621:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324641:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324654:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324669:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324676:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324683:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324709:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324717:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324738:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744317.324779:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788744317.324784:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744317.324798:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324810:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324816:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324823:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324828:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.324832:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324838:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324850:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:1.0:1788744317.324865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744317.324871:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324877:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94b5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324905:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324912:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324917:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324922:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.324925:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324930:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324938:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff940ac3570d00) 00010000:00010000:1.0:1788744317.324940:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744317.324943:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324948:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324972:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324979:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324984:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.324995:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.324998:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.325003:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.325011:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:1.0:1788744317.325013:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744317.325016:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.325020:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.325120:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458560:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 Request processed in 622us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.325128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:0.0:1788744317.337211:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.337431:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458816 00000100:00100000:1.0:1788744317.337446:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458816 00000100:00100000:1.0:1788744317.337526:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:1.0:1788744317.337538:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+52:10449:x1875634047458816:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744317.337601:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744317.337629:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761246 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337754:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337793:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337807:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744317.337823:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788744317.337953:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337960:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337982:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.337989:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744317.337994:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338001:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338015:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:1.0:1788744317.338019:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744317.338024:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338029:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338077:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b71 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761246 expref: 54 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338094:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:1.0:1788744317.338096:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744317.338100:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94b71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761246 expref: 54 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.338109:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2000, rc 0) 00000100:00100000:1.0:1788744317.338181:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047458816:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 646us (985us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788744317.338189:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:3.0:1788744317.346105:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744317.346401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047458944 00000100:00100000:0.0:1788744317.346412:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047458944 00000100:00100000:0.0:1788744317.346484:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:0.0:1788744317.346497:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047458944:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744317.346546:0:5838:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744317.347196:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047458944:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 698us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744317.347205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:0.0:1788744317.364668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.366840:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047459200 00000100:00100000:2.0:1788744317.366859:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047459200 00000100:00100000:2.0:1788744317.366948:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:2.0:1788744317.366972:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047459200:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744317.366996:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744317.366999:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744317.367029:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761238 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.367066:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744317.367072:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744317.367089:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b86 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576124d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744317.367951:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788744317.370772:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.370796:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.370810:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.370912:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b86 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576124d expref: 55 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.370935:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576124d expref: 54 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.370945:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744317.370948:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744317.370952:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744317.371887:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+54:10449:x1875634047459200:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 4921us (7223us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788744317.371897:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:2.0:1788744317.384491:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.388406:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047459456 00000100:00100000:3.0:1788744317.388430:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047459456 00000100:00100000:3.0:1788744317.388518:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 73 00000100:00100000:3.0:1788744317.388531:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+54:10449:x1875634047459456:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.388655:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744317.388698:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576124d expref: 54 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.388720:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744317.388736:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744317.388874:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.388890:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.388900:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.388942:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.388950:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.388957:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389082:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389090:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389097:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389102:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.389107:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389122:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389132:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744317.389135:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744317.389139:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389145:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94b9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389156:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389162:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389167:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389182:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.389185:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389191:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389199:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x686511ea (ffff940ac2bbc400) 00010000:00010000:2.0:1788744317.389202:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744317.389205:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.389210:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ba2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x686511ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.389333:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8176300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047459456:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 803us (4854us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744317.389341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 73 00000100:00100000:1.0:1788744317.403669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744317.405818:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047459584 00000100:00100000:0.0:1788744317.405839:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047459584 00000100:00100000:0.0:1788744317.405915:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:0.0:1788744317.405931:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+53:10449:x1875634047459584:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744317.405956:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744317.405994:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ba9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761254 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417768:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417795:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417812:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417936:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94ba9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417956:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.417976:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:1.0:1788744317.417979:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744317.417990:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2600, rc 0) 00000100:00100000:1.0:1788744317.418086:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+54:10449:x1875634047459584:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 12158us (14428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.418096:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:0.0:1788744317.440365:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.440489:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047459840 00000100:00100000:3.0:1788744317.440510:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047459840 00000100:00100000:3.0:1788744317.440618:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00100000:3.0:1788744317.440631:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+54:10449:x1875634047459840:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.440748:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.440769:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.440802:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744317.441183:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788744317.441193:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389573642764ns, next at 390573640639ns, rc = 0 00000004:00010000:3.0:1788744317.441288:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000dacd1c2f reply state 00000000ec209cb6 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.441298:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744317.441420:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+56:10449:x1875634047459840:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 792us (1067us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788744317.441428:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 75 00010000:00010000:0.0:1788744317.444969:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.444988:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.445011:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.445017:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744317.445022:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.445030:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.445046:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:0.0:1788744317.445061:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744317.445067:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.445074:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94bb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744317.447176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.447415:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047459968 00000100:00100000:3.0:1788744317.447428:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047459968 00000100:00100000:3.0:1788744317.447503:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 76 00000100:00100000:3.0:1788744317.447516:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+55:10449:x1875634047459968:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.447580:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744317.447603:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576125b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.447831:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.447850:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.447873:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:3.0:1788744317.447877:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744317.447881:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f200, rc 0) 00000100:00100000:3.0:1788744317.447948:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+56:10449:x1875634047459968:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 433us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.447955:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 76 00000100:00100000:0.0:1788744317.458787:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.458850:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460096 00000100:00100000:1.0:1788744317.458862:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460096 00000100:00100000:1.0:1788744317.458907:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:1.0:1788744317.458916:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875634047460096:12345-192.168.204.56@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788744317.458950:0:8624:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:1.0:1788744317.458997:0:8624:0:(genops.c:1384:class_connect()) connect: client 03c88f08-96bd-4666-9af8-74d11f561443, cookie 0x7cd2bfd5e1b94bc5 00002000:00100000:1.0:1788744317.459011:0:8624:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03c88f08-96bd-4666-9af8-74d11f561443/ffff940ad2c6e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744317.459023:0:8624:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788744317.459309:0:8624:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788744317.459345:0:8624:0:(import.c:65:import_set_state_nolock()) ffff940ad2c6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744317.459418:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2350:x1875634047460096:12345-192.168.204.56@tcp:8:lhsmtool_posix.0 Request processed in 501us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.459426:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:3.0:1788744317.475160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.475249:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460224 00000100:00100000:3.0:1788744317.475260:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460224 00000100:00100000:3.0:1788744317.475330:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:3.0:1788744317.475341:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:0:x1875634047460224:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788744317.486172:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788744317.591627:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:0.0:1788744317.591657:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:0.0:1788744317.591677:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:0.0:1788744317.592860:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788744317.592882:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940b00945e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788744317.592889:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940b009453c0 00000020:00080000:0.0:1788744317.592892:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940affdcf400 00000001:00080000:0.0:1788744317.592916:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788744317.592929:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788744317.593115:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1788744317.593119:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744317.593142:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068458752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788744317.593229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744317.594680:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068458752 00000020:00080000:0.0:1788744317.594884:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788744317.595028:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744317.595046:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068458880:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788744317.595188:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068458752 00000100:00100000:1.0:1788744317.595330:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744317.595341:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068458752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788744317.595370:0:8624:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788744317.595403:0:8624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e1279, atime: 0x6a9e127a, ctime: 0x6a9e1279, blocks: 0x1 00010000:00010000:1.0:1788744317.595411:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.595441:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1788744317.595445:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744317.595452:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.595469:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.595479:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.595487:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.595504:0:8624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744317.595682:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744317.596012:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788744317.596021:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788744317.597528:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068458880 00000100:00100000:3.0:1788744317.597542:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068458880 00000100:00100000:1.0:1788744317.597746:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875634068458752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2404us (4513us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788744317.597757:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744317.597789:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744317.597798:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068458880:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788744317.597864:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940ad0c4bb80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788744317.597873:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068458752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788744317.597988:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068458880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (2305us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788744317.597995:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788744317.598016:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744317.598021:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788744317.598058:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744317.598067:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.598081:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744317.598086:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.598097:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.598121:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.598129:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b94bcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.598149:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744317.598151:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744317.598153:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788744317.598912:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940ad0c49f80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788744317.598924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068458880:0@lo:2:osp-syn-0-0.0 00000001:00100000:0.0:1788744317.604849:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000001:00080000:0.0:1788744317.646489:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788744317.646518:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788744317.647361:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:0:x1875634047460224:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 172013us (172208us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788744317.647375:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:0.0:1788744317.651377:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.651730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460480 00000100:00100000:1.0:1788744317.651745:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460480 00000100:00100000:1.0:1788744317.651984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744317.651996:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+12:10449:x1875634047460480:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744317.652522:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047460480:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 526us (1156us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788744317.652532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744317.659625:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.659694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460736 00000100:00100000:3.0:1788744317.659705:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460736 00000100:00100000:3.0:1788744317.659997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:3.0:1788744317.660008:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047460736:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744317.660370:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047460736:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 362us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.660392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:1.0:1788744317.665412:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.665451:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460864 00010000:00010000:0.0:1788744317.666968:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744317.669588:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460864 00000100:00100000:1.0:1788744317.669701:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:1.0:1788744317.669714:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047460864:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744317.669743:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744317.669767:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b94bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761262 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671013:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671030:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671043:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744317.671098:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744317.671389:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671426:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b94bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761262 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671472:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761262 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.671482:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:1.0:1788744317.671486:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788744317.671489:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3c00, rc 0) 00000100:00100000:1.0:1788744317.671602:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047460864:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1888us (6199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.671611:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:1.0:1788744317.675604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.675672:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047460992 00000100:00100000:3.0:1788744317.675683:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047460992 00000100:00100000:3.0:1788744317.675748:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:3.0:1788744317.675760:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047460992:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.675886:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744317.675926:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761269 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744317.675970:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e127d, blocks: 0x1 00010000:00010000:3.0:1788744317.675993:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1788744317.675998:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.676008:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.676028:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.676042:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164ee00, rc 0) 00000100:00100000:3.0:1788744317.676151:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047460992:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 392us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.676158:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:2.0:1788744317.689331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.689673:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461248 00000100:00100000:3.0:1788744317.689684:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461248 00000100:00100000:3.0:1788744317.689740:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:3.0:1788744317.689753:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047461248:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744317.689909:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047461248:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 157us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.689918:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:1.0:1788744317.696873:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.697136:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461376 00000100:00100000:3.0:1788744317.697147:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461376 00000100:00100000:3.0:1788744317.697213:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:3.0:1788744317.697224:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:10449:x1875634047461376:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.697368:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744317.697394:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761270 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.697437:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.697447:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.697452:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.697458:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.697505:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.697523:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.697541:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068459008:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744317.700812:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744317.704222:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068459008:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744317.704335:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.704359:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f000, rc 0) 00000100:00100000:2.0:1788744317.704430:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:10449:x1875634047461376:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 7207us (7566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.704439:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:0.0:1788744317.705892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.705972:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461504 00000100:00100000:3.0:1788744317.705982:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461504 00010000:00010000:3.0:1788744317.706019:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.706062:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:3.0:1788744317.706072:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047461504:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744317.706092:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744317.706132:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.706148:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.706176:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b94be1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761269 expref: 7 pid: 6682 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.706194:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.706199:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.706208:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.706218:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.706257:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.706288:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068459136:192.168.204.56@tcp:105: 00000100:00100000:3.0:1788744317.706392:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744317.710983:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068459136:192.168.204.56@tcp:105: 00010000:00010000:0.0:1788744317.711012:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744317.711077:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047461504:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 5004us (5192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744317.711096:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:0.0:1788744317.720265:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.720687:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461632 00000100:00100000:1.0:1788744317.720702:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461632 00002000:00100000:1.0:1788744317.720758:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff940ad0c48700 x1875634047461632/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:593/0 lens 504/0 e 0 to 0 dl 1788744328 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744317.720780:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ad0c48700 with x1875634047461632 ext(0->8) 00002000:00010000:1.0:1788744317.720787:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940ad0c48700 00000100:00100000:1.0:1788744317.720820:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:1.0:1788744317.720829:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047461632:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788744317.722208:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047461632:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 Request processed in 1255us (1828us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788744317.722221:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00002000:00100000:1.0:1788744317.722232:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff940ad0c48700 x1875634047461632/t4294967303(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:593/0 lens 504/448 e 0 to 0 dl 1788744328 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744317.722324:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ad0c48700 with x1875634047461632 ext(0->8) 00002000:00010000:1.0:1788744317.722329:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940ad0c48700 00000100:00100000:2.0:1788744317.730166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.730275:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461760 00000100:00100000:3.0:1788744317.730286:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461760 00000100:00100000:3.0:1788744317.730347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 80 00000100:00100000:3.0:1788744317.730360:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047461760:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788744317.730510:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047461760:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 Request processed in 152us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.730518:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 80 00000100:00100000:3.0:1788744317.748681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.750221:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047461888 00000100:00100000:2.0:1788744317.750499:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047461888 00000100:00100000:2.0:1788744317.750681:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:2.0:1788744317.750697:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047461888:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788744317.818011:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788744317.818489:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047461888:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 Request processed in 67788us (69811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.818502:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:1.0:1788744317.828051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.828108:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462144 00000100:00100000:1.0:1788744317.828118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462144 00000100:00100000:1.0:1788744317.828181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:1.0:1788744317.828195:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047462144:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744317.828294:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744317.828328:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94bda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761262 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.829001:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:1.0:1788744317.829009:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744317.829048:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.829065:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.829081:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744317.829473:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000eb24501a reply state 00000000d692f065 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.829484:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744317.829726:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+15:10449:x1875634047462144:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 1532us (1684us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788744317.829749:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 81 00010000:00010000:3.0:1788744317.838418:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.838440:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.838448:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.838455:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744317.838460:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.838469:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.838480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:3.0:1788744317.838506:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:3.0:1788744317.838509:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744317.838515:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.838522:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94bef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.838579:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462272 00000100:00100000:3.0:1788744317.838591:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462272 00000100:00100000:3.0:1788744317.838693:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:3.0:1788744317.838705:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047462272:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788744317.838992:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788744317.838996:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744316 00002000:00010000:3.0:1788744317.838998:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788744314 00002000:00010000:3.0:1788744317.839000:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788744317 -> 1788744316 00002000:00010000:3.0:1788744317.839002:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788744317.839081:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047462272:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 377us (604us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788744317.839091:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:3.0:1788744317.851249:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.851727:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462528 00000100:00100000:2.0:1788744317.851740:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462528 00000100:00100000:2.0:1788744317.851818:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:2.0:1788744317.851829:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+14:10449:x1875634047462528:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788744317.851906:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.851930:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.851963:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.852003:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.852019:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 14 pid: 5838 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.852038:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068459264:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744317.852166:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b009450c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744317.862709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.862934:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068459264:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744317.862973:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.866236:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462656 00000100:00100000:1.0:1788744317.866264:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462656 00010000:00010000:1.0:1788744317.866313:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 15 pid: 5838 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.866366:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:1.0:1788744317.866378:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+15:2353:x1875634047462656:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744317.866394:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744317.866402:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 15 pid: 5838 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866417:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 15 pid: 5838 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866440:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761254 expref: 15 pid: 5838 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866455:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:1.0:1788744317.866461:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866470:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866479:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.866524:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744317.866609:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+14:2353:x1875634047462656:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 233us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.866617:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00010000:00010000:3.0:1788744317.866967:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.866988:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867021:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867028:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867035:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867041:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744317.867046:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867054:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867065:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:3.0:1788744317.867068:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788744317.867072:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.867078:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94bf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.867162:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047462528:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 Request processed in 15333us (15932us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788744317.867170:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:1.0:1788744317.871135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744317.871760:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462784 00000100:00100000:3.0:1788744317.871877:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462784 00000100:00100000:3.0:1788744317.871969:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:3.0:1788744317.871982:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047462784:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744317.872042:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.872067:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.872078:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744317.872097:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744317.872102:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.872400:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.872416:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744317.872431:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068459392:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744317.872531:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744317.879763:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.879810:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047462912 00000100:00100000:2.0:1788744317.879819:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047462912 00010000:00010000:2.0:1788744317.879863:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 8 pid: 6680 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.879911:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:2.0:1788744317.879923:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047462912:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744317.879940:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744317.879976:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 8 pid: 6680 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.879991:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 8 pid: 6680 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.880028:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1788744317.880034:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744317.880041:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.880052:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.880079:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744317.880139:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047462912:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 218us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744317.880146:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00010000:00010000:1.0:1788744317.880510:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d8ab29d/0x7cd2bfd5e1b94be8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761270 expref: 7 pid: 6680 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.880526:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068459392:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744317.880569:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880580:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880588:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880616:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880623:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880632:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880645:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744317.880650:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880659:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880671:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.880678:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.880727:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047462784:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 Request processed in 8748us (9601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.880734:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:3.0:1788744317.886641:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744317.886720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047463168 00000100:00100000:0.0:1788744317.886732:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047463168 00000100:00100000:0.0:1788744317.886804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 83 00000100:00100000:0.0:1788744317.886815:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10449:x1875634047463168:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788744317.886897:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.886914:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.886937:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.887190:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.887202:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.887211:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.887246:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744317.887261:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 14 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744317.887275:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068459520:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744317.887373:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744317.892434:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ac700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068459520:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744317.892468:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.893623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.894327:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047463296 00000100:00100000:2.0:1788744317.894338:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047463296 00010000:00010000:2.0:1788744317.894386:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 15 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.894465:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:2.0:1788744317.894479:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+15:2354:x1875634047463296:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744317.894502:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744317.894512:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 15 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894527:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 15 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894587:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576125b expref: 15 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894609:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:2.0:1788744317.894615:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894626:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894634:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744317.894802:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744317.894865:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:2354:x1875634047463296:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 388us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.894883:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 45 00010000:00010000:2.0:1788744317.894938:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.894948:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744317.895189:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788744317.897039:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788744317.897122:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788744317.897342:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875634068459648:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788744317.897413:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744317.897450:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744317.900093:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068459648 00000100:00100000:3.0:1788744317.900108:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068459648 00000100:00100000:3.0:1788744317.900172:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744317.900182:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875634068459648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788744317.900317:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875634068459648:12345-0@lo:1000:mdt00_001.0 Request processed in 135us (2902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744317.900325:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744317.900348:0:5837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788744317.900356:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940ad0c49f80, transno 4294967302 00000100:00100000:2.0:1788744317.900378:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875634068459648:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788744317.901041:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788744317.902487:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875634068459776:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788744317.902579:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744317.902617:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744317.902764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068459776 00000100:00100000:0.0:1788744317.902784:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068459776 00000100:00100000:0.0:1788744317.902847:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744317.902858:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875634068459776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788744317.903141:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875634068459776:12345-0@lo:1000:mdt00_001.0 Request processed in 284us (561us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788744317.903148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788744317.903749:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875634068459776:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788744317.903793:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903805:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903814:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903820:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.903825:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903832:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903850:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:2.0:1788744317.903853:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744317.903859:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903865:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94c0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903907:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903914:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903929:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903934:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.903938:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903943:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903964:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:2.0:1788744317.903968:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744317.903971:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.903977:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b94b39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.904002:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.904019:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 17 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.904028:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.904061:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 17 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.904344:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 17 pid: 10823 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.904360:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068459904:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744317.904447:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744317.914518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744317.914576:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047463424 00000100:00100000:1.0:1788744317.914586:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047463424 00010000:00010000:1.0:1788744317.914630:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 18 pid: 10823 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744317.914681:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744317.914693:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+18:2354:x1875634047463424:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744317.914728:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744317.914736:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 18 pid: 10823 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.914752:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 18 pid: 10823 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.914775:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:1.0:1788744317.914781:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.914792:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.914800:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.914819:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744317.914873:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+18:2354:x1875634047463424:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 181us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744317.914880:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00010000:00010000:2.0:1788744317.915935:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b94b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576123f expref: 17 pid: 10823 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.915973:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068459904:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744317.916000:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916009:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916022:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916035:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916042:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916050:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916057:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.916069:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916078:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916092:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:2.0:1788744317.916096:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744317.916100:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916106:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94c12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916120:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916127:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916133:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916139:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744317.916142:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916149:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916156:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ac3570700) 00010000:00010000:2.0:1788744317.916159:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744317.916168:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.916175:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94c04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744317.917014:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+16:10449:x1875634047463168:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 30196us (30381us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788744317.917027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 83 00000020:00080000:2.0:1788744317.917033:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788744317.917189:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744317.917194:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744317.917223:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788744317.918426:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744317.923813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744317.924135:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047463680 00000100:00100000:2.0:1788744317.924150:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047463680 00000100:00100000:2.0:1788744317.924209:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744317.924232:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+16:10449:x1875634047463680:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744317.925054:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744317.925164:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1788744317.925223:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925240:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925253:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925263:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925281:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925287:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744317.925305:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744317.925407:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+18:10449:x1875634047463680:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 1174us (1602us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788744317.925416:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000020:00080000:2.0:1788744317.925423:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788744317.929764:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744317.929783:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.929796:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744317.929800:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.929827:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.929848:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744317.929851:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788744317.929856:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.929862:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744317.929889:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744317.929892:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744317.929895:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744318.364916:0:12002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744318.364927:0:12002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744318.365033:0:12002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788744318.365038:0:12002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744318.540392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.540909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047463936 00000100:00100000:2.0:1788744318.540922:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047463936 00000100:00100000:2.0:1788744318.540996:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 84 00000100:00100000:2.0:1788744318.541008:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+18:10465:x1875634047463936:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744318.541033:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744318.541054:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761277 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.541161:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b94c27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.541175:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b94c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.541189:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b94c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744318.541201:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788744318.541353:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761277 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.541372:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b94c27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761277 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.541381:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744318.541384:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744318.541387:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389000, rc 0) 00000100:00100000:2.0:1788744318.541455:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:10465:x1875634047463936:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 449us (1075us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788744318.541462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 84 00000100:00100000:1.0:1788744318.548045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744318.548429:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047464064 00000100:00100000:3.0:1788744318.548439:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047464064 00000100:00100000:3.0:1788744318.548504:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:3.0:1788744318.548516:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+20:10465:x1875634047464064:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:3.0:1788744318.548622:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.548642:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.548655:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.548718:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.548726:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.548741:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550136:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550151:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550161:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744318.550208:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550221:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550228:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550234:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550240:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.550245:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550251:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550264:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744318.550272:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.550278:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550284:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550483:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550491:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550497:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550502:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.550574:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550581:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550589:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818d00) 00010000:00010000:3.0:1788744318.550592:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.550595:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550600:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550615:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550627:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550632:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550636:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.550639:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550644:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550650:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818600) 00010000:00010000:3.0:1788744318.550652:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.550655:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.550659:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744318.552540:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+20:10465:x1875634047464064:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 4016us (4495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.552577:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:1.0:1788744318.654403:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.654487:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047464320 00000100:00100000:2.0:1788744318.654498:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047464320 00000100:00100000:3.0:1788744318.654638:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:3.0:1788744318.654650:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+20:10468:x1875634047464320:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744318.654672:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744318.654694:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576127e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654806:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654820:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654832:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654850:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654857:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.654863:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655148:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655157:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655165:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744318.655175:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788744318.655274:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655282:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655297:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655303:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.655309:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655316:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655328:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744318.655331:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.655337:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655342:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655354:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655361:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655366:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655371:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.655373:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655389:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655397:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818600) 00010000:00010000:3.0:1788744318.655400:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.655403:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655408:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655458:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655471:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.655478:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:3.0:1788744318.655481:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744318.655483:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031a00, rc 0) 00000100:00100000:3.0:1788744318.655617:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:10468:x1875634047464320:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 970us (1228us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788744318.655626:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:1.0:1788744318.667823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.667905:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047464448 00000100:00100000:2.0:1788744318.667918:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047464448 00000100:00100000:2.0:1788744318.667998:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00100000:2.0:1788744318.668011:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+22:10468:x1875634047464448:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:2.0:1788744318.668104:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668124:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668139:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668169:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668194:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668205:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668211:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.668215:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668223:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668235:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:2.0:1788744318.668238:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744318.668243:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.668248:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744318.668338:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+22:10468:x1875634047464448:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 329us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.668345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00100000:0.0:1788744318.675732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.675844:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047464704 00000100:00100000:2.0:1788744318.675856:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047464704 00000100:00100000:2.0:1788744318.675908:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744318.675919:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8696850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:10468:x1875634047464704:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744318.676185:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8696850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+23:10468:x1875634047464704:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 266us (462us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788744318.676209:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00010000:00010000:0.0:1788744318.682740:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744318.741920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.742046:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047464960 00000100:00100000:2.0:1788744318.742058:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047464960 00000100:00100000:2.0:1788744318.742128:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:2.0:1788744318.742140:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+23:9996:x1875634047464960:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744318.742167:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744318.742191:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761285 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.742321:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.742339:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.742348:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.742387:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.742401:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 24 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744318.742414:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068460032:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744318.742763:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744318.745854:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068460032:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744318.745901:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744318.746200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744318.746467:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465088 00000100:00100000:1.0:1788744318.746476:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465088 00010000:00010000:1.0:1788744318.746532:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 25 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744318.746606:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:1.0:1788744318.746615:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+25:2354:x1875634047465088:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744318.746632:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744318.746640:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 25 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746667:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 25 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746691:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576127e expref: 25 pid: 5837 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746707:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:1.0:1788744318.746712:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746721:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746729:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.746757:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744318.746808:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:2354:x1875634047465088:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 193us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744318.746816:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 47 00010000:00010000:2.0:1788744318.746885:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.746892:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744318.746912:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788744318.747108:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b94c74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.747128:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.747138:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:2.0:1788744318.747141:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744318.747143:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744318.747173:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+24:9996:x1875634047464960:12345-192.168.204.56@tcp:101:bash.0 Request processed in 5035us (5264us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788744318.747181:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:1.0:1788744318.755150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744318.755581:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465344 00000100:00100000:3.0:1788744318.755766:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465344 00000100:00100000:3.0:1788744318.755836:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 89 00000100:00100000:3.0:1788744318.755860:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+24:9996:x1875634047465344:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:3.0:1788744318.756193:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.756212:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.756224:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744318.756278:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788744318.756954:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004136653a reply state 000000002ff08ad8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744318.756967:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788744318.757051:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788744318.757189:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:9996:x1875634047465344:12345-192.168.204.56@tcp:36:bash.0 Request processed in 1329us (2048us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788744318.757197:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 89 00000020:00080000:3.0:1788744318.757203:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788744318.761320:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744318.761482:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465472 00000100:00100000:1.0:1788744318.761493:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465472 00000100:00100000:1.0:1788744318.761596:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 90 00000100:00100000:1.0:1788744318.761608:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+28:9996:x1875634047465472:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:1.0:1788744318.761640:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744318.761666:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576128c expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.761955:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576128c expref: 29 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.761973:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576128c expref: 29 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.761996:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:1.0:1788744318.761999:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744318.762003:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3c00, rc 0) 00000100:00100000:1.0:1788744318.762058:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+29:9996:x1875634047465472:12345-192.168.204.56@tcp:101:bash.0 Request processed in 452us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744318.762066:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 90 00010000:00010000:3.0:1788744318.762491:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762514:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762523:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762530:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.762534:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762590:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762603:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:3.0:1788744318.762606:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744318.762611:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.762618:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94c89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744318.766106:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.773348:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465600 00000100:00100000:2.0:1788744318.773366:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465600 00000100:00100000:2.0:1788744318.773497:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:2.0:1788744318.773519:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:9996:x1875634047465600:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744318.773541:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744318.773870:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761293 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744318.773918:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e127c, atime: 0x6a9e127a, ctime: 0x6a9e127c, blocks: 0xb 00010000:00010000:2.0:1788744318.773956:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1788744318.773962:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744318.773971:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.773990:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.774005:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388600, rc 0) 00000100:00100000:2.0:1788744318.774097:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:9996:x1875634047465600:12345-192.168.204.56@tcp:101:bash.0 Request processed in 590us (8003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.774105:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:0.0:1788744318.781005:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744318.781123:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465728 00000100:00100000:1.0:1788744318.781137:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465728 00002000:00010000:1.0:1788744318.781194:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788744318.781200:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940aff8ace00 with x1875634047465728 ext(0->18446744073709551615) 00002000:00010000:1.0:1788744318.781214:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940aff8ace00. 00000100:00100000:1.0:1788744318.781247:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:1.0:1788744318.781257:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047465728:12345-192.168.204.56@tcp:10:bash.0 00002000:00010000:1.0:1788744318.781621:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788744318.781626:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788744316 -> 1788744318 00002000:00010000:1.0:1788744318.781628:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788744314 -> 1788744314 00002000:00010000:1.0:1788744318.781630:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788744316 -> 1788744318 00002000:00010000:1.0:1788744318.781632:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788744318.782271:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047465728:12345-192.168.204.56@tcp:10:bash.0 Request processed in 1012us (1273us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788744318.782281:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00002000:00010000:1.0:1788744318.782286:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1788744318.782289:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940aff8ace00 with x1875634047465728 ext(0->18446744073709551615) 00002000:00010000:1.0:1788744318.782296:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940aff8ace00. 00000100:00100000:0.0:1788744318.871000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.871956:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047465856 00000100:00100000:2.0:1788744318.871969:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047465856 00000100:00100000:2.0:1788744318.872039:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 91 00000100:00100000:2.0:1788744318.872050:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+28:10482:x1875634047465856:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:2.0:1788744318.872148:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872166:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872181:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872217:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872226:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872241:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872503:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872514:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872521:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744318.872598:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872610:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872616:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872623:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872629:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.872634:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872649:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872661:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744318.872664:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744318.872668:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872674:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872687:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872693:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872699:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872704:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.872706:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872712:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872720:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc800) 00010000:00010000:2.0:1788744318.872723:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744318.872726:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872742:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872757:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872762:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872768:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872785:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.872789:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872794:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872801:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:2.0:1788744318.872804:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744318.872807:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.872812:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744318.872898:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+28:10482:x1875634047465856:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 849us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744318.872906:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 91 00000100:00100000:3.0:1788744318.911708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.912017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047466112 00000100:00100000:2.0:1788744318.912030:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047466112 00000100:00100000:2.0:1788744318.912176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:2.0:1788744318.912188:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:10485:x1875634047466112:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744318.912212:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744318.912233:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576129a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912317:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912332:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912346:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912359:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912365:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.912371:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913425:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913440:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913462:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744318.913475:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788744318.913614:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913622:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913630:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913637:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.913641:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913647:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913660:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744318.913663:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744318.913668:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913673:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913687:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913692:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913704:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.913709:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744318.914409:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914423:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914432:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc800) 00010000:00010000:2.0:1788744318.914435:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744318.914439:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914445:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914501:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576129a expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914515:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576129a expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744318.914523:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:2.0:1788744318.914525:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744318.914528:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744318.914651:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+30:10485:x1875634047466112:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 2464us (2953us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788744318.914672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:0.0:1788744318.919281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744318.919381:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047466240 00000100:00100000:1.0:1788744318.919392:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047466240 00000100:00100000:1.0:1788744318.919506:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:1.0:1788744318.919519:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+30:10485:x1875634047466240:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:1.0:1788744318.919622:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.919641:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 30 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.919652:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.919691:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 30 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.919719:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 30 pid: 6704 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744318.919735:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068460160:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744318.919966:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744318.926732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.926957:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047466496 00000100:00100000:2.0:1788744318.926968:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047466496 00000100:00100000:2.0:1788744318.927027:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:2.0:1788744318.927038:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+31:5593:x1875634047466496:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788744318.927415:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:5593:x1875634047466496:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 377us (691us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788744318.927424:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:1.0:1788744318.928286:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068460160:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744318.928332:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744318.931744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744318.931983:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047466624 00000100:00100000:1.0:1788744318.931994:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047466624 00010000:00010000:1.0:1788744318.932035:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 32 pid: 6704 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744318.932083:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:1.0:1788744318.932104:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+32:2353:x1875634047466624:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744318.932121:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744318.932128:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 32 pid: 6704 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932140:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 32 pid: 6704 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932162:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94c7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761285 expref: 32 pid: 6704 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932181:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:1.0:1788744318.932186:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932196:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932204:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744318.932259:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744318.932320:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+31:2353:x1875634047466624:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 217us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744318.932327:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 48 00010000:00010000:3.0:1788744318.932452:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932461:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932494:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932500:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932507:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932513:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744318.932518:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932537:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932594:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:3.0:1788744318.932598:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744318.932602:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744318.932609:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744318.932651:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+30:10485:x1875634047466240:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 13135us (13380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744318.932659:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:3.0:1788744318.936078:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744318.939763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047466880 00000100:00100000:2.0:1788744318.940001:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047466880 00000100:00100000:2.0:1788744318.940080:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:2.0:1788744318.940093:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+30:10485:x1875634047466880:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744318.940539:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+31:10485:x1875634047466880:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 448us (4470us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788744318.940617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:0.0:1788744318.960306:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744318.960362:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744318.960466:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047467136 00000100:00100000:3.0:1788744318.960477:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047467136 00000100:00100000:3.0:1788744318.960543:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:3.0:1788744318.960582:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047467136:12345-192.168.204.56@tcp:16:kworker.0 00000100:00100000:2.0:1788744318.960751:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047467008 00000100:00100000:2.0:1788744318.960756:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047467008 00002000:00100000:2.0:1788744318.960787:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff940aceeaa300 x1875634047467008/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:594/0 lens 496/0 e 0 to 0 dl 1788744329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744318.960798:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940aceeaa300 with x1875634047467008 ext(0->7) 00002000:00010000:2.0:1788744318.960804:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940aceeaa300 00000100:00100000:2.0:1788744318.960822:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744318.960829:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047467008:12345-192.168.204.56@tcp:4:bash.0 00000100:00100000:2.0:1788744318.961319:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+11:2353:x1875634047467008:12345-192.168.204.56@tcp:4:bash.0 Request processed in 489us (954us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788744318.961332:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00002000:00100000:2.0:1788744318.961341:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff940aceeaa300 x1875634047467008/t4294967307(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:594/0 lens 496/448 e 0 to 0 dl 1788744329 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744318.961350:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940aceeaa300 with x1875634047467008 ext(0->7) 00002000:00010000:2.0:1788744318.961353:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940aceeaa300 00000001:00080000:2.0:1788744319.058481:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788744319.058500:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788744319.058507:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:2.0:1788744319.064116:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047467136:12345-192.168.204.56@tcp:16:kworker.0 Request processed in 103189us (103472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744319.064132:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:0.0:1788744319.123897:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.124090:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047467392 00000100:00100000:3.0:1788744319.124111:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047467392 00000100:00100000:3.0:1788744319.124203:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 94 00000100:00100000:3.0:1788744319.124215:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:10496:x1875634047467392:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:3.0:1788744319.124240:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744319.124260:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124364:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124380:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124392:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124407:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124414:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.124421:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788744319.124994:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744319.125283:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125296:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125304:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744319.125314:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788744319.125435:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125443:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125460:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125467:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744319.125471:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125479:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125493:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744319.125496:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744319.125502:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125509:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125526:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125532:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125538:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.125543:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744319.125547:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.126982:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.127009:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818600) 00010000:00010000:3.0:1788744319.127012:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744319.127018:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.127025:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.128410:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a1 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.128440:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a1 expref: 33 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.128449:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:3.0:1788744319.128452:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744319.128455:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031a00, rc 0) 00000100:00100000:3.0:1788744319.128703:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+33:10496:x1875634047467392:12345-192.168.204.56@tcp:101:cat.0 Request processed in 4487us (4817us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788744319.128712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 94 00000100:00100000:1.0:1788744319.142749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744319.144524:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047467648 00000100:00100000:0.0:1788744319.144539:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047467648 00000100:00100000:0.0:1788744319.144713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:0.0:1788744319.144727:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+33:10496:x1875634047467648:12345-192.168.204.56@tcp:35:cat.0 00000100:00100000:0.0:1788744319.145030:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+34:10496:x1875634047467648:12345-192.168.204.56@tcp:35:cat.0 Request processed in 305us (2291us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788744319.145038:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:0.0:1788744319.198143:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.198231:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047467904 00000100:00100000:3.0:1788744319.198243:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047467904 00000100:00100000:3.0:1788744319.198325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 95 00000100:00100000:3.0:1788744319.198337:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+34:10497:x1875634047467904:12345-192.168.204.56@tcp:36:rm.0 00010000:00010000:3.0:1788744319.198426:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744319.198460:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a1 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198504:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576129a expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198519:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576128c expref: 32 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198531:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818d00) 00010000:00010000:3.0:1788744319.198543:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744319.198622:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198637:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198647:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198662:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198670:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198677:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198957:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198966:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.198973:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744319.199522:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788744319.199532:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 391331981981ns, next at 392331979437ns, rc = 0 00010000:00010000:3.0:1788744319.199642:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199660:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199667:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199673:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199679:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199696:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788744319.199717:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199730:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199736:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199742:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744319.199746:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199755:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199766:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818900) 00010000:00010000:3.0:1788744319.199769:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788744319.199773:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199779:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94d0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199799:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199804:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199810:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199814:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744319.199823:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199829:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199837:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744319.199840:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744319.199843:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.199849:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744319.199858:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000072c4a0e7 reply state 000000006ea18a1b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744319.199866:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744319.199971:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+33:10497:x1875634047467904:12345-192.168.204.56@tcp:36:rm.0 Request processed in 1633us (1840us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788744319.199980:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 95 00010000:00010000:1.0:1788744319.200379:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744319.200386:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.200393:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744319.200396:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.200403:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.200412:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff940ad8818900) 00010000:00010000:1.0:1788744319.200414:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788744319.200417:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.200422:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.200440:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744319.200441:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744319.200443:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744319.230911:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.230942:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.230952:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.230959:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.230964:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.230971:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.230991:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818600) 00010000:00010000:2.0:1788744319.231019:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.231026:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.231032:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94d07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744319.290784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.294371:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468160 00000100:00100000:3.0:1788744319.294389:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468160 00000100:00100000:3.0:1788744319.294468:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 96 00000100:00100000:3.0:1788744319.294481:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+32:10503:x1875634047468160:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:3.0:1788744319.294508:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744319.294531:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94d1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612a8 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294874:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294908:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294921:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294950:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294958:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.294965:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744319.301069:0:10823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788744319.305309:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305335:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305350:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305422:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305430:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305437:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305443:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.305448:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305455:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305489:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744319.305492:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.305498:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305505:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94d23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744319.305527:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c25ab101 reply state 00000000384af34d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.305536:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788744319.305644:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94d1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 35 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.305661:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 34 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.308198:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.308207:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744319.308211:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389400, rc 0) 00000100:00100000:2.0:1788744319.309309:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+35:10503:x1875634047468160:12345-192.168.204.56@tcp:101:bash.0 Request processed in 14819us (18532us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788744319.309322:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 96 00000100:00100000:0.0:1788744319.313518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744319.314198:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468288 00000100:00100000:1.0:1788744319.314211:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468288 00000100:00100000:1.0:1788744319.314325:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:1.0:1788744319.314336:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047468288:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:1.0:1788744319.314356:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744319.314380:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612af expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744319.314412:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744319.314434:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788744319.314439:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744319.314450:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.314468:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.314483:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3000, rc 0) 00000100:00100000:1.0:1788744319.314544:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047468288:12345-192.168.204.56@tcp:101:bash.0 Request processed in 210us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744319.314580:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00080000:2.0:1788744319.315087:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788744319.315905:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.315922:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.315941:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.315948:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744319.315953:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.315962:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.316009:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad8818d00) 00010000:00010000:3.0:1788744319.316012:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744319.316019:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.316026:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94d2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744319.318090:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.318167:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468416 00000100:00100000:2.0:1788744319.318177:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468416 00000100:00100000:2.0:1788744319.318238:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:2.0:1788744319.318250:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad81e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:10503:x1875634047468416:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744319.318282:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744319.318303:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612b6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.318342:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.318351:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744319.318356:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744319.318361:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.318397:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.318411:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 9 pid: 6680 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.318425:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875634068460288:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744319.318523:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744319.324219:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875634068460288:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744319.324507:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.324532:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389800, rc 0) 00000100:00100000:3.0:1788744319.329162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744319.329607:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468544 00000100:00100000:1.0:1788744319.329631:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468544 00010000:00010000:1.0:1788744319.329683:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 10 pid: 6680 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744319.330112:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:1.0:1788744319.330124:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+10:2354:x1875634047468544:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744319.330162:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744319.330189:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 10 pid: 6680 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.330204:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 10 pid: 6680 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.330231:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6378151/0x7cd2bfd5e1b94d3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612af expref: 10 pid: 6680 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.330250:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744319.330254:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744319.330262:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.330272:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.330539:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744319.330613:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068460416:192.168.204.56@tcp:105: 00000100:00100000:1.0:1788744319.330725:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1c1dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744319.331506:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad81e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:10503:x1875634047468416:12345-192.168.204.56@tcp:101:bash.0 Request processed in 13255us (13423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.331516:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:1.0:1788744319.341135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.342097:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468800 00000100:00100000:2.0:1788744319.342108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468800 00000100:00100000:2.0:1788744319.342175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:2.0:1788744319.342187:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+34:10503:x1875634047468800:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:2.0:1788744319.342598:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:10503:x1875634047468800:12345-192.168.204.56@tcp:35:bash.0 Request processed in 413us (1471us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788744319.342606:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:0.0:1788744319.352538:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068460416:192.168.204.56@tcp:105: 00010000:00010000:0.0:1788744319.352584:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744319.352652:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047468544:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 22529us (23500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.352663:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:1.0:1788744319.557262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.557355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047468928 00000100:00100000:3.0:1788744319.557365:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047468928 00000100:00100000:0.0:1788744319.557578:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:0.0:1788744319.557590:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+35:10519:x1875634047468928:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744319.557615:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744319.557635:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557698:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557779:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557794:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744319.557830:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788744319.557834:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744319.557852:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557877:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612bd expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557895:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612bd expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.557911:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:0.0:1788744319.557914:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744319.557917:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:0.0:1788744319.558001:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+36:10519:x1875634047468928:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 413us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.558009:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:1.0:1788744319.562085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744319.562116:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469184 00000100:00100000:1.0:1788744319.562126:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469184 00000100:00100000:1.0:1788744319.562174:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 98 00000100:00100000:1.0:1788744319.562183:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+36:10519:x1875634047469184:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744319.562202:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744319.562220:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612c4 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.562326:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.562342:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.562353:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744319.562366:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788744319.562490:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612c4 expref: 39 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.562507:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612c4 expref: 38 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.562515:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744319.562520:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744319.562524:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2600, rc 0) 00000100:00100000:1.0:1788744319.562590:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+38:10519:x1875634047469184:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 408us (520us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788744319.562608:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 98 00000001:00080000:1.0:1788744319.563054:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788744319.563064:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788744319.565892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.567099:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469440 00000100:00100000:2.0:1788744319.567115:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469440 00000100:00100000:3.0:1788744319.567187:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.567234:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 99 00000100:00100000:2.0:1788744319.567258:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+38:10519:x1875634047469440:12345-192.168.204.56@tcp:101:lfs.0 00000100:00100000:1.0:1788744319.567275:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469568 00000100:00100000:1.0:1788744319.567280:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469568 00010000:00010000:2.0:1788744319.567297:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744319.567324:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612cb expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744319.567360:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:1.0:1788744319.567368:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+40:2353:x1875634047469568:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744319.567384:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744319.567412:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b94d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612c4 expref: 40 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744319.567433:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744319.567438:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744319.567466:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.567483:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.567495:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744319.567506:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+39:2353:x1875634047469568:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 139us (502us total) trans 0 rc 0/0 00000004:00200000:2.0:1788744319.567509:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1788744319.567514:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00010000:00010000:2.0:1788744319.567676:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612cb expref: 40 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.567691:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612cb expref: 39 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.567725:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.567729:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744319.567731:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744319.567756:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+39:10519:x1875634047469440:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 512us (1874us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788744319.567763:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 99 00000100:00100000:1.0:1788744319.573763:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.573817:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469696 00000100:00100000:2.0:1788744319.573829:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469696 00000100:00100000:2.0:1788744319.573899:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:2.0:1788744319.573909:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047469696:12345-192.168.204.56@tcp:1:lfs.0 00010000:00010000:2.0:1788744319.574172:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.574195:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.574204:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744319.574209:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744319.574214:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.574479:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.574498:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 6 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.574535:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068460544:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744319.574666:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa900 going to sleep for 11 seconds 00000100:00100000:2.0:1788744319.577857:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068460544:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744319.577891:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744319.578199:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.578286:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469824 00000100:00100000:2.0:1788744319.578294:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469824 00002000:00100000:2.0:1788744319.578343:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff940b0097c380 x1875634047469824/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:595/0 lens 504/0 e 0 to 0 dl 1788744330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744319.578353:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940b0097c380 with x1875634047469824 ext(0->8) 00010000:00010000:2.0:1788744319.578361:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 7 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.578374:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 7 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744319.578382:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940b0097c380 00000100:00100000:2.0:1788744319.578417:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744319.578426:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047469824:12345-192.168.204.56@tcp:4:lfs.0 00000100:00100000:2.0:1788744319.579245:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2354:x1875634047469824:12345-192.168.204.56@tcp:4:lfs.0 Request processed in 815us (1042us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788744319.579255:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00002000:00100000:2.0:1788744319.579277:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff940b0097c380 x1875634047469824/t4294967302(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:595/0 lens 504/448 e 0 to 0 dl 1788744330 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744319.579287:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940b0097c380 with x1875634047469824 ext(0->8) 00010000:00010000:2.0:1788744319.579295:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.579313:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744319.579319:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940b0097c380 00000100:00100000:1.0:1788744319.581851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.582465:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047469952 00000100:00100000:3.0:1788744319.582477:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047469952 00010000:00010000:3.0:1788744319.582528:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744319.582821:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:0.0:1788744319.582834:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047469952:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744319.582850:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788744319.582870:0:5821:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788744319.582873:0:5821:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788744319 00002000:00010000:0.0:1788744319.582876:0:5821:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788744319 00002000:00010000:0.0:1788744319.582879:0:5821:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788744319 00010000:00010000:0.0:1788744319.582886:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.582899:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.582940:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b94d46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612b6 expref: 9 pid: 6681 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.582957:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744319.582962:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744319.582982:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.582992:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.583196:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744319.583258:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047469952:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 427us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.583267:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00010000:00010000:2.0:1788744319.583913:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.583941:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584048:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584057:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584065:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584072:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744319.584087:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584097:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584112:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.584120:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee5ebf04/0x7cd2bfd5e1b94d85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.584259:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047469696:12345-192.168.204.56@tcp:1:lfs.0 Request processed in 10349us (10503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744319.584278:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:1.0:1788744319.587163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.587282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047470208 00000100:00100000:2.0:1788744319.587294:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047470208 00000100:00100000:2.0:1788744319.587392:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:2.0:1788744319.587405:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8694450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+39:10519:x1875634047470208:12345-192.168.204.56@tcp:35:lfs.0 00000004:00010000:2.0:1788744319.587475:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612cb expref: 39 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744319.587885:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788744319.587950:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788744319.588443:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788744319.588509:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.588541:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 43 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.588630:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.588665:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 43 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.588677:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 43 pid: 10823 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.588692:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068460672:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744319.588801:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744319.592590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.592671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047470336 00000100:00100000:3.0:1788744319.592681:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047470336 00010000:00010000:3.0:1788744319.592790:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 44 pid: 10823 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744319.592871:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:3.0:1788744319.592882:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+44:2354:x1875634047470336:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744319.592898:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744319.592905:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 44 pid: 10823 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.592950:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 44 pid: 10823 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.592978:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744319.592984:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.592994:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.593002:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.593022:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744319.593210:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612a8 expref: 44 pid: 10823 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.593227:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068460672:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744319.593249:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.593259:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.593265:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744319.593342:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+43:2354:x1875634047470336:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 462us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744319.593350:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 51 00000001:00080000:2.0:1788744319.593419:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788744319.593704:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788744319.593837:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068460800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744319.593895:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744319.593935:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa000 going to sleep for 11 seconds 00000100:00100000:0.0:1788744319.594182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068460800 00000100:00100000:0.0:1788744319.594189:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068460800 00000100:00100000:0.0:1788744319.594269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744319.594277:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068460800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744319.594355:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068460800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.594366:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788744319.594724:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744319.594754:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788744319.594760:0:5840:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1788744319.594778:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940ad0c4bb80, transno 4294967301 00000100:00100000:2.0:1788744319.594802:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068460800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744319.595310:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788744319.595399:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068460928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744319.595449:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744319.595482:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa900 going to sleep for 11 seconds 00000100:00100000:0.0:1788744319.595689:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068460928 00000100:00100000:0.0:1788744319.595696:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068460928 00000100:00100000:0.0:1788744319.595739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744319.595748:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068460928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744319.595944:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875634068460928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 197us (494us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788744319.595960:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788744319.596034:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068460928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788744319.596085:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788744319.596125:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596137:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596146:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596152:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.596156:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596164:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596191:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.596194:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788744319.596201:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.596207:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94d8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744319.596393:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788744319.596494:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788744319.596508:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391728957889ns, next at 392728955156ns, rc = 0 00000001:00080000:2.0:1788744319.596513:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788744319.596641:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.596645:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744319.596651:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612cb expref: 47 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.596758:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8694450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+46:10519:x1875634047470208:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 9355us (9608us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788744319.596767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 26 00000020:00080000:2.0:1788744319.596771:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788744319.599525:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744319.599908:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047470464 00000100:00100000:0.0:1788744319.599928:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047470464 00000100:00100000:0.0:1788744319.600212:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 100 00000100:00100000:0.0:1788744319.600223:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+46:10519:x1875634047470464:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744319.600262:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744319.600286:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.600348:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d2 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.600362:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d2 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.600397:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744319.600400:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744319.600404:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297400, rc 0) 00000100:00100000:0.0:1788744319.600470:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+47:10519:x1875634047470464:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 249us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.600477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 100 00000100:00100000:1.0:1788744319.604388:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744319.604500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047470720 00000100:00100000:0.0:1788744319.604513:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047470720 00000100:00100000:0.0:1788744319.604737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:0.0:1788744319.604750:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+47:10519:x1875634047470720:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:0.0:1788744319.605045:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+48:10519:x1875634047470720:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 297us (666us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788744319.605054:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:1.0:1788744319.698464:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.698577:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047470848 00000100:00100000:2.0:1788744319.698589:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047470848 00000100:00100000:2.0:1788744319.698670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 101 00000100:00100000:2.0:1788744319.698684:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+48:10529:x1875634047470848:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:2.0:1788744319.698790:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.698829:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.698845:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.698863:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.698870:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.698877:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699050:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699059:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699067:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744319.699115:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699129:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699136:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699154:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699160:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.699165:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699172:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699185:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744319.699188:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.699192:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699198:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699212:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699217:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699222:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699227:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.699230:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699244:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699537:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.699541:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.699544:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699710:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699729:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699735:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699741:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699746:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.699749:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699755:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699763:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744319.699765:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.699768:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.699786:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744319.700438:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+48:10529:x1875634047470848:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1751us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744319.700451:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 101 00010000:00010000:0.0:1788744319.706672:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744319.773375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.773489:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047471104 00000100:00100000:2.0:1788744319.773501:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047471104 00000100:00100000:2.0:1788744319.773585:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:2.0:1788744319.773595:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+48:10532:x1875634047471104:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744319.773619:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744319.773644:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612d9 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773721:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773737:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773750:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773765:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773772:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773779:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773899:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773932:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.773940:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744319.773959:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788744319.774220:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774235:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774241:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774247:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.774250:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774258:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774269:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744319.774272:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.774277:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774282:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774296:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774316:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774322:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774326:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.774329:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774335:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774343:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc800) 00010000:00010000:2.0:1788744319.774346:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.774349:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774354:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774395:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d9 expref: 51 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774408:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d9 expref: 50 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.774415:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744319.774417:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744319.774426:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744319.774505:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+50:10532:x1875634047471104:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 910us (1139us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788744319.774512:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:2.0:1788744319.791469:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744319.795359:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047471232 00000100:00100000:0.0:1788744319.795379:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047471232 00000100:00100000:0.0:1788744319.795530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 103 00000100:00100000:0.0:1788744319.795575:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+50:10532:x1875634047471232:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:0.0:1788744319.795648:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795667:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795681:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795725:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795733:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795740:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795747:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744319.795751:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795760:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795773:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744319.795777:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744319.795782:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744319.795789:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744319.795968:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+50:10532:x1875634047471232:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 396us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744319.795977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 103 00000100:00100000:1.0:1788744319.813461:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.813661:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047471488 00000100:00100000:2.0:1788744319.813671:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047471488 00000100:00100000:2.0:1788744319.813751:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:2.0:1788744319.813762:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+50:10532:x1875634047471488:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744319.814422:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+51:10532:x1875634047471488:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 659us (967us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788744319.814431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:1.0:1788744319.939258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.939411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047471744 00000100:00100000:3.0:1788744319.939425:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047471744 00000100:00100000:3.0:1788744319.939496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 104 00000100:00100000:3.0:1788744319.939510:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+51:10542:x1875634047471744:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:3.0:1788744319.939546:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744319.939583:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744319.939622:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612bd expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.939664:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744319.939671:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744319.939927:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612e0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.940048:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.940428:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.940443:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744319.940457:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788744319.940670:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b94dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e0 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.940772:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e0 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.940783:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744319.940786:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744319.940789:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f200, rc 0) 00000100:00100000:3.0:1788744319.941047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+52:10542:x1875634047471744:12345-192.168.204.56@tcp:101:bash.0 Request processed in 1539us (1805us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788744319.941057:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 104 00000100:00100000:1.0:1788744319.946130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744319.946248:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472000 00000100:00100000:2.0:1788744319.946260:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472000 00000100:00100000:2.0:1788744319.946348:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 105 00000100:00100000:2.0:1788744319.946358:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+52:10542:x1875634047472000:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:2.0:1788744319.946419:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788744319.946445:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b94de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e0 expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.946470:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d9 expref: 51 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.946483:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744319.946488:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744319.946777:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.946809:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.946820:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744319.946876:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788744319.946900:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000012ff3941 reply state 000000005ecc17de transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744319.946910:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744319.947236:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+53:10542:x1875634047472000:12345-192.168.204.56@tcp:36:bash.0 Request processed in 877us (1231us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788744319.947243:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 105 00000020:00080000:2.0:1788744319.947248:0:10823:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744319.951921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744319.951997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472128 00000100:00100000:3.0:1788744319.952017:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472128 00000100:00100000:3.0:1788744319.952134:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 106 00000100:00100000:3.0:1788744319.952147:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+53:10542:x1875634047472128:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:3.0:1788744319.952177:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744319.952203:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.952307:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.952320:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.952341:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.952359:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.952372:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953138:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953151:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953159:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953166:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744319.953170:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953177:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953222:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744319.953225:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744319.953228:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953236:0:3297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953242:0:3297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953274:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744319.953281:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94dee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.953348:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.953355:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744319.953395:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744319.953399:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744319.953432:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.953473:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b94df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.953490:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744319.953497:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744319.953500:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744319.953503:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0030200, rc 0) 00000100:00100000:3.0:1788744319.953627:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+53:10542:x1875634047472128:12345-192.168.204.56@tcp:101:bash.0 Request processed in 1481us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744319.953635:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 106 00000100:00100000:1.0:1788744319.958377:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744319.958490:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472384 00000100:00100000:0.0:1788744319.958505:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472384 00000100:00100000:0.0:1788744319.959516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:0.0:1788744319.959534:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+53:10542:x1875634047472384:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:0.0:1788744319.959882:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+54:10542:x1875634047472384:12345-192.168.204.56@tcp:35:bash.0 Request processed in 353us (1517us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788744319.959891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:2.0:1788744320.028070:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744320.028165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744320.028618:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461056 00000100:00100000:1.0:1788744320.028628:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461056 00000100:00100000:1.0:1788744320.028695:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788744320.028707:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068461056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744320.028748:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744320.028820:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068461056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744320.028829:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788744320.028939:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744320.029160:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068461440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744320.029196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744320.029222:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744320.029400:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068461184:0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744320.029467:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068461696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029490:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744320.029511:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744320.029517:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068461312:0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029540:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744320.029593:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461440 00000100:00100000:3.0:1788744320.029598:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461440 00000100:00100000:3.0:1788744320.029631:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461696 00000100:00100000:3.0:1788744320.029634:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461696 00000100:00100000:3.0:1788744320.029674:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461312 00000100:00100000:3.0:1788744320.029678:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461312 00000100:00100000:3.0:1788744320.029692:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788744320.029700:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068461440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029753:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068461440:12345-0@lo:400:kworker.0 Request processed in 54us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744320.029761:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788744320.029775:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744320.029781:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068461696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029812:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068461696:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744320.029817:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788744320.029829:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788744320.029835:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068461312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029864:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068461312:12345-0@lo:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744320.029869:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788744320.029898:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068461312:0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.029909:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068461696:0@lo:400:kworker.0 00000100:00100000:0.0:1788744320.030495:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068461568:0@lo:400:kworker.0 00000100:00100000:0.0:1788744320.030543:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744320.030618:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068461440:0@lo:400:kworker.0 00000100:00100000:0.0:1788744320.030649:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461184 00000100:00100000:0.0:1788744320.030654:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461184 00000100:00100000:0.0:1788744320.030690:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788744320.030697:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068461184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744320.030811:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068461184:12345-0@lo:400:kworker.0 Request processed in 113us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.030818:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788744320.030876:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068461184:0@lo:400:kworker.0 00000100:00080000:2.0:1788744320.031085:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744320.031412:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068461568 00000100:00100000:3.0:1788744320.031419:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068461568 00000100:00100000:3.0:1788744320.031479:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788744320.031488:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068461568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744320.031574:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068461568:12345-0@lo:400:kworker.0 Request processed in 88us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744320.031593:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788744320.031660:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788744320.031667:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788744320.031689:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068461568:0@lo:400:kworker.0 00000100:00080000:2.0:1788744320.031799:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744320.052191:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744320.052403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472512 00000100:00100000:3.0:1788744320.052415:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472512 00000100:00100000:3.0:1788744320.052492:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 107 00000100:00100000:3.0:1788744320.052504:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+54:10548:x1875634047472512:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744320.052531:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744320.052597:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052678:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052693:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052704:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744320.052739:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788744320.052743:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744320.052761:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052787:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612ee expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052806:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612ee expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744320.052834:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744320.052837:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744320.052841:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0030400, rc 0) 00000100:00100000:3.0:1788744320.052908:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047472512:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 406us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744320.052928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 107 00000100:00100000:3.0:1788744320.061222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744320.061431:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472640 00000100:00100000:0.0:1788744320.061445:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472640 00000100:00100000:0.0:1788744320.061530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 108 00000100:00100000:0.0:1788744320.061541:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047472640:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744320.061629:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744320.061661:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062056:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062072:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062084:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062101:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062108:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062115:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062664:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062677:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.062703:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744320.063021:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788744320.063026:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744320.063049:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063064:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063072:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063078:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063084:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063089:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744320.063093:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063100:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063113:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:0.0:1788744320.063116:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744320.063134:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063154:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063172:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063178:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063184:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063190:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744320.063193:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063199:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063207:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ad90aff00) 00010000:00010000:0.0:1788744320.063210:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744320.063213:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063218:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.063996:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.064017:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.064036:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744320.064038:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744320.064041:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:0.0:1788744320.064301:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+56:10548:x1875634047472640:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 2759us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.064309:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 108 00000100:00100000:1.0:1788744320.071476:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744320.071533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744320.075588:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047472896 00000100:00100000:2.0:1788744320.075603:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047472896 00000100:00100000:2.0:1788744320.075678:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 109 00000100:00100000:2.0:1788744320.075688:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+56:10548:x1875634047472896:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744320.075709:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744320.075732:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57612fc expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075846:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075861:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075869:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075876:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075908:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.075933:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 57 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744320.075946:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068461824:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744320.076051:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.076185:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744320.076195:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad1d00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068461952:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744320.076237:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744320.080653:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473024 00000100:00100000:0.0:1788744320.080669:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473024 00010000:00010000:0.0:1788744320.081144:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 58 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744320.081193:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:0.0:1788744320.081205:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+58:2354:x1875634047473024:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744320.081221:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744320.081664:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 58 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.081683:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 58 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.081706:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744320.082145:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.082158:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.082183:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744320.082490:0:10823:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.56@tcp) returned -22 from blocking AST (req@000000002a0cd4c3 x1875634068461824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 58 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.082505:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612f5 expref: 58 pid: 5837 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744320.082522:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d01880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068461824:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744320.082535:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad1d00000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068461952:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744320.082583:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744320.082588:0:10823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.082595:0:10823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.082603:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744320.082687:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+57:2354:x1875634047473024:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 1483us (11151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.082695:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:1.0:1788744320.083022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744320.084661:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473152 00000100:00100000:0.0:1788744320.084677:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473152 00010000:00010000:0.0:1788744320.085307:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744320.085348:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:0.0:1788744320.085504:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+57:2353:x1875634047473152:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744320.085527:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744320.085535:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085579:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085602:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030200/0x7cd2bfd5e1b94dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612e7 expref: 57 pid: 5838 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085623:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744320.085628:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085638:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085663:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.085691:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744320.085750:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+56:2353:x1875634047473152:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 392us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.085757:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 53 00010000:00010000:2.0:1788744320.085832:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.085841:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744320.085863:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788744320.086046:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 57 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.087784:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 56 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744320.087796:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744320.087799:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744320.087804:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388400, rc 0) 00000100:00100000:2.0:1788744320.087895:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+56:10548:x1875634047472896:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 12206us (16428us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788744320.087905:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 109 00000100:00100000:3.0:1788744320.095461:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744320.095759:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473408 00000100:00100000:1.0:1788744320.095772:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473408 00000100:00100000:1.0:1788744320.095848:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:1.0:1788744320.095860:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+56:10548:x1875634047473408:12345-192.168.204.56@tcp:103:lfs.0 00010000:00010000:1.0:1788744320.095877:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744320.095905:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612d2 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744320.095935:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744320.095941:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744320.096015:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047473408:12345-192.168.204.56@tcp:103:lfs.0 Request processed in 156us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744320.096023:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:1.0:1788744320.099687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744320.099786:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473536 00000100:00100000:0.0:1788744320.099797:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473536 00000100:00100000:0.0:1788744320.099865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 110 00000100:00100000:0.0:1788744320.099877:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047473536:12345-192.168.204.56@tcp:58:lfs.0 00010000:00010000:0.0:1788744320.100067:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.100085:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.100097:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744320.100325:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788744320.100421:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047473536:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 546us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.100431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 110 00000100:00100000:3.0:1788744320.104668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744320.104764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473664 00000100:00100000:0.0:1788744320.104777:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473664 00000100:00100000:0.0:1788744320.104842:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 111 00000100:00100000:0.0:1788744320.104854:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+55:10548:x1875634047473664:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744320.104897:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744320.104933:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761303 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105004:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105015:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105039:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105053:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105076:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744320.105080:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744320.105084:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744320.105092:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297200, rc 0) 00000100:00100000:0.0:1788744320.105175:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+56:10548:x1875634047473664:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 323us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744320.105182:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 111 00010000:00010000:1.0:1788744320.730796:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744320.986865:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744320.986876:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744320.986941:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788744320.986951:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744320.987119:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068462080:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744320.990440:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae0760600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744320.996196:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744320.996365:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473792 00000100:00100000:2.0:1788744320.996376:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473792 00000100:00100000:2.0:1788744320.996449:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 112 00000100:00100000:2.0:1788744320.996462:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047473792:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744320.996501:0:10823:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744320.996650:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047473792:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 191us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744320.996658:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 112 00000100:00100000:0.0:1788744320.997802:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068462080:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744321.004440:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.004961:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047473920 00000100:00100000:1.0:1788744321.004973:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047473920 00000100:00100000:0.0:1788744321.005168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 113 00000100:00100000:0.0:1788744321.005182:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+56:10550:x1875634047473920:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788744321.005276:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005295:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005309:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005365:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005381:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005407:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005417:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005424:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744321.005481:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788744321.005485:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744321.005514:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005526:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005532:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005539:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005545:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744321.005577:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005584:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005596:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:0.0:1788744321.005599:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744321.005605:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005610:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005625:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005640:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005645:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005649:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744321.005653:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005659:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005666:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff940ad90aff00) 00010000:00010000:0.0:1788744321.005668:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744321.005671:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005677:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94e57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005692:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005699:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005705:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005709:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744321.005718:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005724:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005732:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744321.005734:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744321.005737:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.005743:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744321.006302:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744321.006454:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+56:10550:x1875634047473920:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 Request processed in 1273us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.006464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 113 00000100:00100000:1.0:1788744321.011067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.011224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047474176 00000100:00100000:3.0:1788744321.011236:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047474176 00000100:00100000:3.0:1788744321.011294:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:3.0:1788744321.011304:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+56:10550:x1875634047474176:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744321.011327:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744321.011348:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576130a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011448:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011463:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011474:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744321.011504:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788744321.011645:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011653:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011659:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011665:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.011669:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011676:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011688:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744321.011691:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744321.011696:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011703:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011761:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576130a expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011771:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:3.0:1788744321.011774:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744321.011785:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576130a expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.011796:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0030e00, rc 0) 00000100:00100000:3.0:1788744321.011852:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474176:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 548us (804us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788744321.011859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:3.0:1788744321.019387:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.019488:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047474304 00000100:00100000:0.0:1788744321.019500:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047474304 00000100:00100000:0.0:1788744321.019593:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:0.0:1788744321.019605:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474304:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744321.019646:0:5838:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744321.019765:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474304:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 161us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.019773:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:1.0:1788744321.035859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.036177:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047474560 00000100:00100000:2.0:1788744321.036191:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047474560 00000100:00100000:2.0:1788744321.036283:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 116 00000100:00100000:2.0:1788744321.036295:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474560:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744321.036319:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744321.036323:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744321.036351:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612ee expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.036387:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:2.0:1788744321.036392:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744321.036408:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94e7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761311 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788744321.036970:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788744321.037169:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.037184:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.037194:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.037248:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94e7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761311 expref: 59 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.037264:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761311 expref: 58 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.037271:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744321.037274:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744321.037276:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388c00, rc 0) 00000100:00100000:2.0:1788744321.037338:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+58:10550:x1875634047474560:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1045us (1489us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788744321.037346:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 116 00000004:00080000:3.0:1788744321.050996:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 393183443235ns, next at 394183439217ns, rc = 0 00000100:00100000:1.0:1788744321.051161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.051399:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047474816 00000100:00100000:3.0:1788744321.051411:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047474816 00000100:00100000:3.0:1788744321.051483:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:3.0:1788744321.051494:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+58:10550:x1875634047474816:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00000100:00100000:2.0:1788744321.051501:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744321.051522:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068462208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744321.051590:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788744321.051606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744321.051621:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761311 expref: 58 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051642:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ac2bbc800) 00000100:00100000:2.0:1788744321.051653:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068462208 00010000:00010000:3.0:1788744321.051655:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744321.051659:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068462208 00010000:00010000:3.0:1788744321.051678:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.051690:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1788744321.051694:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.051699:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068462208:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744321.051725:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1788744321.051732:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744321.051790:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068462208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (184us total) trans 0 rc 0/0 00010000:00010000:3.0:1788744321.051792:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.051799:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1788744321.051816:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051824:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.051847:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068462208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744321.051903:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051911:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051916:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051922:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.051926:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051933:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051940:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744321.051943:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744321.051946:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051952:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94e8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051961:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051973:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051980:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051984:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.051988:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.051994:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.052001:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf9b3dfb0 (ffff940ad8818400) 00010000:00010000:3.0:1788744321.052004:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744321.052007:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.052012:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94e96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf9b3dfb0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.052106:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474816:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 615us (951us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744321.053436:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:3.0:1788744321.055164:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.055719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047474944 00000100:00100000:0.0:1788744321.055729:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047474944 00000100:00100000:0.0:1788744321.055785:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:0.0:1788744321.055805:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+57:10550:x1875634047474944:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744321.055844:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744321.055870:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761318 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.055918:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.055932:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.055942:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.056036:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.056070:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.056079:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:0.0:1788744321.056083:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744321.056086:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297000, rc 0) 00000100:00100000:0.0:1788744321.056869:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+58:10550:x1875634047474944:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1070us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.056878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:2.0:1788744321.072106:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.072634:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047475200 00000100:00100000:1.0:1788744321.072648:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047475200 00000100:00100000:1.0:1788744321.072800:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 119 00000100:00100000:1.0:1788744321.072812:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+58:10550:x1875634047475200:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744321.072927:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.072946:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.072961:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744321.073238:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1788744321.073339:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002a0cd4c3 reply state 00000000380769f7 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.073351:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744321.073463:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+60:10550:x1875634047475200:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 653us (1368us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788744321.073489:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 119 00010000:00010000:3.0:1788744321.080091:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080108:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080137:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080143:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.080148:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080155:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080171:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:3.0:1788744321.080174:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788744321.080179:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.080185:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b94eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.093341:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.093486:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047475328 00000100:00100000:3.0:1788744321.093497:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047475328 00000100:00100000:3.0:1788744321.093602:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:3.0:1788744321.093613:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+59:10550:x1875634047475328:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744321.093638:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744321.093872:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576131f expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.093952:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 60 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.093967:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 60 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.093985:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:2.0:1788744321.093989:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744321.093993:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744321.094055:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+60:10550:x1875634047475328:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 443us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744321.094083:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:2.0:1788744321.108454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.108615:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047475456 00000100:00100000:0.0:1788744321.108627:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047475456 00000100:00100000:0.0:1788744321.108704:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:0.0:1788744321.108713:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047475456:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788744321.109602:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744321.109800:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047475456:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 1073us (1342us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788744321.109811:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:3.0:1788744321.116142:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.116349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047475712 00000100:00100000:0.0:1788744321.116359:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047475712 00000100:00100000:0.0:1788744321.116421:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:0.0:1788744321.116432:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+60:10550:x1875634047475712:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744321.116718:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+61:10550:x1875634047475712:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 286us (600us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788744321.116728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:1.0:1788744321.122810:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.123033:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047475968 00000100:00100000:3.0:1788744321.123043:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047475968 00000100:00100000:3.0:1788744321.123094:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 121 00000100:00100000:3.0:1788744321.123106:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+61:10550:x1875634047475968:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788744321.123247:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+61:10550:x1875634047475968:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 143us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.123255:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 121 00000100:00100000:1.0:1788744321.127314:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.127414:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476096 00000100:00100000:2.0:1788744321.127425:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476096 00000100:00100000:2.0:1788744321.127486:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:2.0:1788744321.127496:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+61:10550:x1875634047476096:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744321.127526:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744321.127571:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761326 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.127640:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.127656:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.127667:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744321.127703:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744321.127723:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.127762:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b94eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761326 expref: 63 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.127783:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761326 expref: 62 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.128024:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:2.0:1788744321.128027:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788744321.128030:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744321.128194:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+62:10550:x1875634047476096:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 698us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744321.128202:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:2.0:1788744321.137951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.138088:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476224 00000100:00100000:3.0:1788744321.138100:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476224 00000100:00100000:3.0:1788744321.138162:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:3.0:1788744321.138172:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047476224:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744321.138191:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744321.138218:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576132d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744321.138245:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1280, blocks: 0x1 00010000:00010000:3.0:1788744321.138265:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:3.0:1788744321.138270:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744321.138279:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.138299:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.138313:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0031a00, rc 0) 00000100:00100000:3.0:1788744321.138379:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047476224:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 209us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.138386:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:1.0:1788744321.143376:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.143452:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476480 00000100:00100000:2.0:1788744321.143461:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476480 00000100:00100000:2.0:1788744321.143521:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00100000:2.0:1788744321.143531:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+62:10550:x1875634047476480:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788744321.143665:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+62:10550:x1875634047476480:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 135us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744321.143673:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 123 00000100:00100000:1.0:1788744321.147769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.147940:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476608 00000100:00100000:0.0:1788744321.147951:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476608 00000100:00100000:0.0:1788744321.148011:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:0.0:1788744321.148021:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:10550:x1875634047476608:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744321.148053:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744321.148075:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761334 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.148108:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.148130:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744321.148134:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744321.148139:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 9 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.148182:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.148195:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.148209:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068462336:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744321.148364:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae0760900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744321.161936:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068462336:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744321.161991:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 9 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.162017:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296800, rc 0) 00000100:00100000:3.0:1788744321.162099:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+9:10550:x1875634047476608:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 14078us (14339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.162109:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:2.0:1788744321.163070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.163261:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476736 00000100:00100000:3.0:1788744321.163270:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476736 00010000:00010000:3.0:1788744321.163307:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.163348:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:3.0:1788744321.163359:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047476736:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744321.163376:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744321.163404:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.163418:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.163441:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576132d expref: 9 pid: 6682 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.163460:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744321.163475:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744321.163484:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.163493:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.163880:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.163905:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068462464:192.168.204.56@tcp:105: 00000100:00100000:3.0:1788744321.164079:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744321.173685:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.173864:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d6fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068462464:192.168.204.56@tcp:105: 00010000:00010000:3.0:1788744321.173899:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744321.174014:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047476736:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 10656us (10948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.174024:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:0.0:1788744321.174959:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476864 00000100:00100000:0.0:1788744321.174968:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476864 00002000:00100000:0.0:1788744321.175025:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff940ae5d67800 x1875634047476864/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:597/0 lens 504/0 e 0 to 0 dl 1788744332 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744321.175036:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ae5d67800 with x1875634047476864 ext(0->12) 00002000:00010000:0.0:1788744321.175051:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940ae5d67800 00000100:00100000:0.0:1788744321.175081:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:0.0:1788744321.175090:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047476864:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788744321.175721:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03c88f08-96bd-4666-9af8-74d11f561443+10:2354:x1875634047476864:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 Request processed in 630us (2044us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788744321.175728:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00002000:00100000:0.0:1788744321.175736:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff940ae5d67800 x1875634047476864/t4294967309(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:597/0 lens 504/448 e 0 to 0 dl 1788744332 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744321.175756:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940ae5d67800 with x1875634047476864 ext(0->12) 00002000:00010000:0.0:1788744321.175766:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940ae5d67800 00000100:00100000:0.0:1788744321.185491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.185661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047476992 00000100:00100000:1.0:1788744321.185670:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047476992 00000100:00100000:1.0:1788744321.185726:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 124 00000100:00100000:1.0:1788744321.185737:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+62:10550:x1875634047476992:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788744321.352483:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788744321.352530:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788744321.352575:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788744321.352587:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:0.0:1788744321.352638:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788744321.352656:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ad0daa000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788744321.352661:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ad31ce700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ad0daacc0 00000020:00080000:0.0:1788744321.352665:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ad31ce200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940aff987400 00000020:00080000:0.0:1788744321.352710:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940b009450c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788744321.352714:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ad0e3e0c0 00000020:00080000:0.0:1788744321.352717:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940af73f0c00 00000020:00080000:0.0:1788744321.352868:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788744321.353388:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788744321.353410:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068462592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788744321.353490:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788744321.353685:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788744321.353709:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788744321.353838:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068462592 00000100:00100000:2.0:1788744321.353848:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068462592 00000100:00100000:2.0:1788744321.353927:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788744321.353938:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068462592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788744321.353968:0:6681:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788744321.354003:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e127f, atime: 0x6a9e127f, ctime: 0x6a9e127f, blocks: 0x1 00010000:00010000:2.0:1788744321.354012:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.354031:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788744321.354064:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744321.354073:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.354093:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.354104:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.354114:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.354134:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744321.354715:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634068462592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 778us (1224us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788744321.354725:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788744321.354772:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788744321.355239:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940aff8ad500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788744321.355247:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068462592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788744321.355260:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744321.355269:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068462720:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788744321.355305:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744321.355345:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068462720 00000100:00100000:0.0:1788744321.355353:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068462720 00000100:00100000:0.0:1788744321.355399:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744321.355408:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068462720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788744321.355435:0:11969:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788744321.355462:0:11969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.355483:0:11969:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.355491:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788744321.355495:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744321.355500:0:11969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356028:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744321.356049:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356060:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744321.356065:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356076:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356112:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356120:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b94ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.356146:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744321.356148:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744321.356150:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744321.356257:0:11969:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.356278:0:11969:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 9 pid: 6681 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.356293:0:11969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceea8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11969:1875634068462848:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744321.356492:0:11969:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744321.357930:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+15:10550:x1875634047476992:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 Request processed in 172185us (172439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.357942:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 124 00000100:00100000:0.0:1788744321.367794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.374907:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047477120 00000100:00100000:3.0:1788744321.374925:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047477120 00000100:00100000:3.0:1788744321.375055:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:3.0:1788744321.375066:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+10:2354:x1875634047477120:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788744321.375651:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.375677:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047477248 00000100:00100000:0.0:1788744321.375682:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047477248 00010000:00010000:0.0:1788744321.375712:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 11 pid: 6681 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.375776:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:0.0:1788744321.375784:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+11:2354:x1875634047477248:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744321.375796:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744321.375802:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 11 pid: 6681 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.375817:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 11 pid: 6681 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.375844:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744321.375849:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744321.375855:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.375864:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.375898:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744321.375952:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+11:2354:x1875634047477248:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 169us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.375959:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 55 00010000:00010000:1.0:1788744321.376683:0:11969:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b94c97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761293 expref: 10 pid: 6681 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.376707:0:11969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceea8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11969:1875634068462848:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744321.376755:0:11969:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.376766:0:11969:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.376774:0:11969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.376785:0:11969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.376810:0:11969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.376836:0:11969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788744321.377521:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068462720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22111us (22212us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788744321.377530:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788744321.378009:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744321.378020:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.378984:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744321.378992:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.379007:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.379138:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.379147:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b94edc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.379181:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744321.379183:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744321.379185:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788744321.390130:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940ad8174700/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788744321.390159:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068462720:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788744321.475867:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788744321.475903:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1788744321.476606:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047477120:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 Request processed in 101535us (108817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.476620:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:0.0:1788744321.481366:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.481469:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047477504 00000100:00100000:2.0:1788744321.481480:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047477504 00000100:00100000:2.0:1788744321.481595:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 125 00000100:00100000:2.0:1788744321.481606:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+15:10550:x1875634047477504:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744321.481666:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744321.481697:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761326 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.481736:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:2.0:1788744321.481742:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744321.481773:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.481787:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.481798:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744321.482087:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002d460dbd reply state 000000008486bc5e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.482098:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744321.482200:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+16:10550:x1875634047477504:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 596us (844us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788744321.482207:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 125 00010000:00010000:2.0:1788744321.485459:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485478:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485488:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485505:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744321.485510:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485545:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485597:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:2.0:1788744321.485600:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744321.485607:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.485614:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.493710:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.493974:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047477632 00000100:00100000:1.0:1788744321.493993:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047477632 00000100:00100000:1.0:1788744321.494069:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:1.0:1788744321.494080:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047477632:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788744321.494350:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788744321.494355:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744319 00002000:00010000:1.0:1788744321.494357:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788744319 00002000:00010000:1.0:1788744321.494360:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788744320 -> 1788744319 00002000:00010000:1.0:1788744321.494362:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788744321.494431:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047477632:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 352us (732us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788744321.494438:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:0.0:1788744321.497040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.497126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047477888 00000100:00100000:3.0:1788744321.497136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047477888 00000100:00100000:3.0:1788744321.497190:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 126 00000100:00100000:3.0:1788744321.497201:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+15:10550:x1875634047477888:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788744321.497284:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.497317:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.497326:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.497364:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.497378:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 15 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.497392:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068462976:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744321.497592:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744321.508077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.508369:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478016 00000100:00100000:1.0:1788744321.508380:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478016 00010000:00010000:1.0:1788744321.508423:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 16 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.508508:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:1.0:1788744321.508520:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+16:2353:x1875634047478016:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744321.508546:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744321.508583:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 16 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.508597:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 16 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.508621:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:1.0:1788744321.508628:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.508638:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.508647:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.508669:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744321.508729:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+16:2353:x1875634047478016:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 211us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744321.508737:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 56 00010000:00010000:3.0:1788744321.520136:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761318 expref: 15 pid: 5837 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.520169:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068462976:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744321.520196:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.520468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.520518:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.520595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744321.520634:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478400 00000100:00100000:0.0:1788744321.520643:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478400 00000100:00100000:0.0:1788744321.520717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 157 00000100:00100000:0.0:1788744321.520739:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047478400:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744321.520829:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047478400:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.520837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 157 00000100:00080000:0.0:1788744321.520860:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744321.521337:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521349:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521383:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521391:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521400:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521407:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744321.521412:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521419:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521446:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:2.0:1788744321.521450:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788744321.521455:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.521462:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b94eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.521538:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+14:10550:x1875634047477888:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 Request processed in 24328us (24505us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788744321.521546:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 126 00000100:00100000:3.0:1788744321.522366:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478272 00000100:00100000:3.0:1788744321.522376:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478272 00000100:00100000:3.0:1788744321.522459:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:3.0:1788744321.522469:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047478272:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744321.522540:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047478272:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 63us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.522581:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00080000:2.0:1788744321.523172:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744321.523239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478144 00000100:00100000:0.0:1788744321.523245:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478144 00000100:00100000:0.0:1788744321.523295:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 298 00000100:00100000:0.0:1788744321.523303:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047478144:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744321.523346:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047478144:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 44us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.523352:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 298 00000100:00100000:0.0:1788744321.533592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.533678:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478528 00000100:00100000:3.0:1788744321.533691:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478528 00000100:00100000:3.0:1788744321.533742:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:3.0:1788744321.533753:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047478528:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744321.533802:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.533823:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 7 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.533833:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744321.533837:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744321.533842:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.533880:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 7 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.533914:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 7 pid: 8624 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744321.533930:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068463104:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744321.534039:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744321.560091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.560396:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478656 00000100:00100000:1.0:1788744321.560407:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478656 00010000:00010000:1.0:1788744321.560446:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.560503:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744321.560513:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047478656:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744321.560528:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744321.560597:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.560612:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 8 pid: 8624 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.560638:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744321.560643:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744321.560651:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.560661:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.560683:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744321.560748:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047478656:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 236us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744321.560756:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 57 00010000:00010000:0.0:1788744321.560986:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eeb6c62/0x7cd2bfd5e1b94ece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761334 expref: 7 pid: 8624 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.561006:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068463104:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744321.561046:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561059:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561068:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561109:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561119:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561128:0:8624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561135:0:8624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744321.561140:0:8624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561149:0:8624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561163:0:8624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.561171:0:8624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b94ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.561220:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047478528:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 Request processed in 27469us (27694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.561229:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:0.0:1788744321.567741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.567901:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047478912 00000100:00100000:2.0:1788744321.567911:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047478912 00000100:00100000:2.0:1788744321.567989:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 127 00000100:00100000:2.0:1788744321.568004:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+14:10550:x1875634047478912:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744321.568110:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568130:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568141:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568358:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568370:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 15 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568394:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568432:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 15 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.568448:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 15 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.568462:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068463232:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744321.568591:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744321.574342:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068463232:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744321.574383:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.579637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.579833:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047479040 00000100:00100000:1.0:1788744321.579843:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047479040 00010000:00010000:1.0:1788744321.579895:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 16 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.579957:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:1.0:1788744321.579967:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+16:2354:x1875634047479040:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744321.579989:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744321.579996:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 16 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580009:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 16 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580043:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576131f expref: 16 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580059:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:1.0:1788744321.580064:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580073:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580081:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.580113:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744321.580170:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+15:2354:x1875634047479040:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 204us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744321.580177:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 58 00010000:00010000:0.0:1788744321.580510:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.580520:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744321.580763:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788744321.580929:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788744321.581177:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788744321.582272:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068463360:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788744321.582335:0:10823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744321.582367:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d05240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744321.583391:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068463360 00000100:00100000:3.0:1788744321.583402:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068463360 00000100:00100000:3.0:1788744321.583459:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744321.583469:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068463360:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744321.583602:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068463360:12345-0@lo:1000:mdt00_004.0 Request processed in 135us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.583609:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744321.583700:0:10823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788744321.583722:0:10823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940ad8174700, transno 4294967310 00000100:00100000:1.0:1788744321.583744:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068463360:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788744321.584448:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788744321.584530:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068463488:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788744321.584601:0:10823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744321.584623:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788744321.585090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068463488 00000100:00100000:3.0:1788744321.585100:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068463488 00000100:00100000:3.0:1788744321.585146:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744321.585156:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068463488:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744321.585638:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10823:x1875634068463488:12345-0@lo:1000:mdt00_004.0 Request processed in 482us (1035us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788744321.585647:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788744321.586351:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068463488:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788744321.586397:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586409:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586418:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586425:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744321.586429:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586437:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586454:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90aff00) 00010000:00010000:1.0:1788744321.586458:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744321.586463:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586469:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586526:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586572:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586579:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586584:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744321.586587:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586593:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586600:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744321.586602:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744321.586609:0:10823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586620:0:10823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586628:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.586663:0:10823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.586690:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068463616:192.168.204.56@tcp:105: 00000100:00100000:1.0:1788744321.586774:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d91c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744321.592816:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.593058:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068463616:192.168.204.56@tcp:105: 00010000:00010000:1.0:1788744321.593093:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593103:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94e42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593141:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593155:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593167:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593177:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593184:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593189:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593194:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744321.593198:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593219:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593231:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744321.593234:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744321.593237:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593243:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b94f06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593252:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593367:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593373:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593378:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744321.593381:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593387:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593395:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744321.593397:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744321.593400:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.593416:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.593748:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+18:10550:x1875634047478912:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 25746us (26030us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788744321.593758:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 127 00000020:00080000:1.0:1788744321.593764:0:10823:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788744321.594239:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744321.594244:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744321.594987:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788744321.594998:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744321.604241:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047479168 00000100:00100000:0.0:1788744321.604413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.604472:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047479168 00000100:00100000:0.0:1788744321.604725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047479424 00000100:00100000:0.0:1788744321.604729:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047479424 00000100:00100000:0.0:1788744321.604747:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:0.0:1788744321.604768:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:10548:x1875634047479168:12345-192.168.204.56@tcp:49:lfs.0 00000100:00100000:0.0:1788744321.604931:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:10548:x1875634047479168:12345-192.168.204.56@tcp:49:lfs.0 Request processed in 174us (12131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744321.604958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:0.0:1788744321.606352:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:0.0:1788744321.606373:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8697c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+18:10550:x1875634047479424:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788744321.609993:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788744321.610154:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788744321.610279:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610299:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610316:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610327:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610334:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610342:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744321.610373:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744321.610515:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8697c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:10550:x1875634047479424:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 4145us (6101us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788744321.610525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 32 00000020:00080000:0.0:1788744321.610541:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744321.611383:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744321.611394:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.611405:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744321.611410:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.611419:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.611438:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:3.0:1788744321.611441:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744321.611460:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.611466:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.611491:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744321.611493:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744321.611495:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744321.621627:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.621826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047479680 00000100:00100000:3.0:1788744321.621837:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047479680 00000100:00100000:3.0:1788744321.621915:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00100000:3.0:1788744321.621927:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+20:10548:x1875634047479680:12345-192.168.204.56@tcp:58:lfs.0 00000040:00080000:3.0:1788744321.622267:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788744321.622358:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+20:10548:x1875634047479680:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 433us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.622368:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 128 00000100:00100000:1.0:1788744321.668305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744321.668475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047479808 00000100:00100000:2.0:1788744321.668486:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047479808 00000100:00100000:2.0:1788744321.668595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 129 00000100:00100000:2.0:1788744321.668609:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:10552:x1875634047479808:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744321.668643:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744321.668665:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576133b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668734:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668751:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668763:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668799:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668808:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.668814:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.669190:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.669202:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 21 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.669211:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.669249:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 21 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744321.669722:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 21 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744321.669739:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068463744:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744321.669842:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744321.674604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744321.674860:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480064 00000100:00100000:3.0:1788744321.674871:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480064 00000100:00100000:3.0:1788744321.674932:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:3.0:1788744321.674943:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:5593:x1875634047480064:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744321.675218:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+23:5593:x1875634047480064:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 276us (667us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788744321.675226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:2.0:1788744321.676514:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c4aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875634068463744:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744321.676589:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744321.679242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744321.679425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480192 00000100:00100000:1.0:1788744321.679434:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480192 00010000:00010000:1.0:1788744321.679472:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 23 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744321.679512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:1.0:1788744321.679521:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+23:2353:x1875634047480192:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744321.679580:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744321.679588:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 23 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679602:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 23 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679622:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57612fc expref: 23 pid: 10823 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679639:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744321.679656:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679666:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679673:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744321.679704:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744321.679752:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+22:2353:x1875634047480192:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 232us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744321.679759:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 59 00010000:00010000:3.0:1788744321.680505:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680515:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744321.680608:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788744321.680612:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744321.680632:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680645:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680653:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680659:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680666:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680672:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.680676:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680683:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680694:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:3.0:1788744321.680697:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744321.680700:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680706:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680741:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680747:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680753:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680759:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744321.680761:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680768:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680777:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff940ac2bbc100) 00010000:00010000:3.0:1788744321.680779:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744321.680782:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680788:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680828:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b94f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576133b expref: 22 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680842:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576133b expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744321.680861:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744321.680864:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744321.680867:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389400, rc 0) 00000100:00100000:3.0:1788744321.680935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+21:10552:x1875634047479808:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 12328us (12640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744321.680942:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 129 00010000:00010000:0.0:1788744321.755052:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788744322.650801:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744322.650812:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744322.650853:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788744322.650870:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744322.651031:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940affa6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068463872:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744322.651126:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744322.655436:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744322.655615:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480320 00000100:00100000:1.0:1788744322.655625:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480320 00000100:00100000:1.0:1788744322.655680:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 130 00000100:00100000:1.0:1788744322.655691:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+22:10563:x1875634047480320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744322.655729:0:10823:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744322.655850:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+22:10563:x1875634047480320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 161us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744322.655858:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 130 00000100:00100000:2.0:1788744322.656808:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940affa6ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068463872:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744322.662839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744322.662959:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480576 00000100:00100000:0.0:1788744322.662970:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480576 00000100:00100000:0.0:1788744322.663047:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 131 00000100:00100000:0.0:1788744322.663059:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+21:10563:x1875634047480576:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744322.663085:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744322.663107:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761342 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744322.663214:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744322.663229:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744322.663257:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744322.663270:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788744322.663422:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761342 expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744322.663453:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761342 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744322.663461:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:0.0:1788744322.663464:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744322.663468:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:0.0:1788744322.663544:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+23:10563:x1875634047480576:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 486us (718us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788744322.663573:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 131 00000100:00100000:3.0:1788744322.672672:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744322.672901:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480832 00000100:00100000:2.0:1788744322.672913:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480832 00000100:00100000:2.0:1788744322.672993:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 132 00000100:00100000:2.0:1788744322.673006:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:10563:x1875634047480832:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788744322.673107:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673129:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673143:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673343:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673351:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673358:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673364:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744322.673368:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673376:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673396:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:2.0:1788744322.673399:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744322.673405:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744322.673412:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b94f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744322.673607:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:10563:x1875634047480832:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 602us (944us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788744322.673615:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 132 00000040:00080000:2.0:1788744322.673744:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744322.673750:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744322.674201:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788744322.674210:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744322.677997:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744322.679091:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047480960 00000100:00100000:3.0:1788744322.679107:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047480960 00000100:00100000:3.0:1788744322.679185:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744322.679196:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:2352:x1875634047480960:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744322.679215:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744322.679245:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761342 expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744322.679263:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744322.679269:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744322.679347:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:2352:x1875634047480960:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 153us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744322.679358:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744322.679496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744322.679612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481216 00000100:00100000:3.0:1788744322.679618:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481216 00000100:00100000:3.0:1788744322.679647:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:3.0:1788744322.679657:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+23:10563:x1875634047481216:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744322.681593:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+24:10563:x1875634047481216:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 240us (400us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788744322.681610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00000040:00080000:0.0:1788744322.753989:0:12054:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744322.753997:0:12054:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744322.755375:0:12054:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788744322.755384:0:12054:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788744322.782121:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744323.048468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744323.048512:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481472 00000100:00100000:3.0:1788744323.048524:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481472 00000100:00100000:3.0:1788744323.048621:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 133 00000100:00100000:3.0:1788744323.048633:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+24:10576:x1875634047481472:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744323.048664:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744323.048687:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761349 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.048804:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94f53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.048823:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.048838:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744323.048864:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788744323.049017:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b94f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761349 expref: 27 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.049038:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761349 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.049069:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:3.0:1788744323.049072:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788744323.049076:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0030400, rc 0) 00000100:00100000:3.0:1788744323.049151:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+26:10576:x1875634047481472:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 521us (692us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788744323.049159:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 133 00000100:00080000:3.0:1788744323.049187:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744323.058845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744323.059196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481600 00000100:00100000:1.0:1788744323.059210:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481600 00000100:00100000:1.0:1788744323.059278:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 134 00000100:00100000:1.0:1788744323.059290:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+26:10576:x1875634047481600:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:1.0:1788744323.059381:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059401:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059433:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059466:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059628:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059635:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059640:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744323.059645:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059653:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744323.059670:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744323.059674:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744323.059680:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744323.059770:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+26:10576:x1875634047481600:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 480us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744323.059778:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 134 00000100:00100000:0.0:1788744323.210040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744323.210174:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481728 00000100:00100000:3.0:1788744323.210185:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481728 00000100:00100000:3.0:1788744323.210275:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:3.0:1788744323.210286:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047481728:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:3.0:1788744323.210307:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744323.210330:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b94f68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761350 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744323.210361:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e127f, atime: 0x6a9e127f, ctime: 0x6a9e127f, blocks: 0xb 00010000:00010000:3.0:1788744323.210382:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788744323.210387:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744323.210398:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b94f68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761350 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.210424:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b94f68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761350 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744323.210458:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac0030200, rc 0) 00000100:00100000:3.0:1788744323.210531:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047481728:12345-192.168.204.56@tcp:101:cat.0 Request processed in 246us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744323.210539:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00080000:2.0:1788744323.210709:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744323.214893:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744323.215015:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481856 00000100:00100000:2.0:1788744323.215030:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481856 00002000:00100000:2.0:1788744323.215092:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff940affa6ca80 x1875634047481856/t0(0) o3->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:599/0 lens 488/0 e 0 to 0 dl 1788744334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744323.215103:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940affa6ca80 with x1875634047481856 ext(0->4095) 00002000:00010000:2.0:1788744323.215109:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940affa6ca80 00000100:00100000:2.0:1788744323.215143:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:2.0:1788744323.215154:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047481856:12345-192.168.204.56@tcp:3:cat.0 00000100:00100000:2.0:1788744323.215404:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047481856:12345-192.168.204.56@tcp:3:cat.0 Request processed in 251us (521us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788744323.215428:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00002000:00100000:2.0:1788744323.215436:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff940affa6ca80 x1875634047481856/t0(0) o3->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:599/0 lens 488/4536 e 0 to 0 dl 1788744334 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744323.215444:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940affa6ca80 with x1875634047481856 ext(0->4095) 00002000:00010000:2.0:1788744323.215448:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940affa6ca80 00010000:00010000:0.0:1788744323.805360:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788744324.673476:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788744324.673496:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788744324.673502:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1788744324.828518:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744325.151712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068464000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744325.151844:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744325.151998:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744325.152009:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152057:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744325.152101:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068464512:0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152104:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068464640:0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152159:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744325.152166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744325.152215:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068464384:0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152245:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068464256:0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744325.152285:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744325.152290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464128 00000100:00100000:2.0:1788744325.152300:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464128 00000100:00100000:0.0:1788744325.152329:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464640 00000100:00100000:0.0:1788744325.152335:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464640 00000100:00100000:2.0:1788744325.152369:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788744325.152383:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068464128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152389:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464384 00000100:00100000:0.0:1788744325.152411:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464384 00000100:00100000:2.0:1788744325.152452:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068464128:12345-0@lo:400:kworker.0 Request processed in 71us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744325.152456:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464256 00000100:00100000:0.0:1788744325.152461:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464256 00000100:00100000:2.0:1788744325.152463:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788744325.152482:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788744325.152491:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068464640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152513:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744325.152523:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068464384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152540:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068464640:12345-0@lo:400:kworker.0 Request processed in 49us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744325.152580:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788744325.152605:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068464384:12345-0@lo:400:kworker.0 Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744325.152605:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788744325.152614:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068464256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788744325.152656:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464512 00000100:00100000:2.0:1788744325.152661:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464512 00000100:00100000:0.0:1788744325.152662:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068464256:12345-0@lo:400:kworker.0 Request processed in 49us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744325.152672:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788744325.152705:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788744325.152713:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068464512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744325.152727:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068464256:0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152758:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068464512:12345-0@lo:400:kworker.0 Request processed in 44us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744325.152766:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788744325.152769:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068464640:0@lo:400:kworker.0 00000100:00100000:1.0:1788744325.152787:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464000 00000100:00100000:1.0:1788744325.152794:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464000 00000100:00080000:2.0:1788744325.152803:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744325.152809:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744325.152831:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744325.152853:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744325.152859:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace37aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068464512:0@lo:400:kworker.0 00000100:00100000:1.0:1788744325.152867:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068464000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744325.152874:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788744325.152904:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068464384:0@lo:400:kworker.0 00002000:00000024:1.0:1788744325.152912:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744325.152970:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068464000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744325.152977:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788744325.153299:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788744325.153307:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788744325.153330:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940aff8ad500, transno 4294967304 00000100:00100000:2.0:1788744325.153357:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068464000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788744325.857098:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744326.171045:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068464768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744326.171250:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788744326.171601:0:6769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398304049895ns, next at 399304044953ns, rc = 0 00000100:00100000:3.0:1788744326.171652:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464768 00000100:00100000:3.0:1788744326.171664:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464768 00000100:00100000:3.0:1788744326.171731:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788744326.171745:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068464768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744326.174045:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744326.175509:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8174700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068464768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744326.176094:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00941180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068464768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3690us (4182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744326.176120:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744326.631528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744326.631609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744326.631637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744326.631668:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744326.631688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744326.631716:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482496 00000100:00100000:1.0:1788744326.631727:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482496 00000100:00100000:1.0:1788744326.631779:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482112 00000100:00100000:1.0:1788744326.631781:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482112 00000100:00100000:1.0:1788744326.631815:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 161 00000100:00100000:1.0:1788744326.631825:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2351:x1875634047482496:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744326.631888:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2351:x1875634047482496:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 64us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744326.631895:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 161 00000100:00100000:1.0:1788744326.631910:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 162 00000100:00100000:1.0:1788744326.631916:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:2351:x1875634047482112:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744326.631954:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:2351:x1875634047482112:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 37us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744326.631960:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 162 00000100:00100000:1.0:1788744326.631993:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482240 00000100:00100000:1.0:1788744326.631996:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482240 00000100:00100000:1.0:1788744326.632020:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482368 00000100:00100000:1.0:1788744326.632022:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482368 00000100:00100000:1.0:1788744326.632040:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:1.0:1788744326.632046:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2351:x1875634047482240:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744326.632071:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2351:x1875634047482240:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744326.632076:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:1.0:1788744326.632086:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00100000:1.0:1788744326.632092:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2351:x1875634047482368:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744326.632109:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2351:x1875634047482368:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 17us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744326.632114:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00080000:1.0:1788744326.632127:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744326.632130:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744326.632132:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744326.632903:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047481984 00000100:00100000:2.0:1788744326.632912:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047481984 00000100:00100000:2.0:1788744326.633015:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 300 00000100:00100000:2.0:1788744326.633032:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047481984:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744326.633084:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047481984:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 54us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744326.633091:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 300 00000001:00080000:0.0:1788744326.751540:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1788744326.751587:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788744326.751604:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ad1d91e40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788744326.751609:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ac30d1600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ad1d91540 00000020:00080000:0.0:1788744326.751612:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ac30d1d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940adbf35800 00000001:00080000:0.0:1788744326.751621:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000004:00080000:0.0:1788744326.751633:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788744326.751646:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788744326.751666:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788744326.753223:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788744326.754489:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068464896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788744326.754586:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744326.755604:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068464896 00000100:00100000:0.0:1788744326.755621:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068464896 00000100:00100000:0.0:1788744326.755679:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744326.755690:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068464896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788744326.756017:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788744326.756021:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788744319 -> 1788744319 00002000:00010000:0.0:1788744326.756024:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1788744319 -> 1788744319 00002000:00010000:0.0:1788744326.756027:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788744319 -> 1788744319 00002000:00010000:0.0:1788744326.756030:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788744326.756308:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068464896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 618us (1720us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788744326.756316:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:3.0:1788744326.757240:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940afa5cf100/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788744326.757251:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068464896:0@lo:2:osp-syn-0-0.0 00000040:00080000:2.0:1788744326.757626:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744326.757632:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744326.757706:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788744326.757713:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788744326.760887:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1788744326.760910:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:1.0:1788744326.878320:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744327.899294:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744328.923117:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744329.132506:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744329.132644:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482624 00000100:00100000:0.0:1788744329.132655:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482624 00000100:00080000:1.0:1788744329.132898:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744329.136248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 135 00000100:00100000:0.0:1788744329.136273:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10237:x1875634047482624:12345-192.168.204.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788744329.136401:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10237:x1875634047482624:12345-192.168.204.56@tcp:60:lhsmtool_posix.0 Request processed in 140us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744329.136409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 135 00000100:00100000:3.0:1788744329.138687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744329.139278:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047482880 00000100:00100000:1.0:1788744329.139292:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047482880 00000100:00100000:1.0:1788744329.139370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:1.0:1788744329.139382:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:10237:x1875634047482880:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744329.139824:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:10237:x1875634047482880:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 443us (1146us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788744329.139853:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 35 00010000:00010000:0.0:1788744329.947227:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744330.272059:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744330.272083:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068465408:0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.272085:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068465792:0@lo:400:kworker.0 00000100:00100000:0.0:1788744330.272172:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068465152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744330.272181:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068465024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.276208:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744330.276320:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465792 00000100:00100000:2.0:1788744330.276328:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465792 00000100:00100000:2.0:1788744330.276401:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744330.276415:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068465792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.276481:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068465792:12345-0@lo:400:kworker.0 Request processed in 71us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744330.276488:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788744330.276514:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744330.276566:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068465792:0@lo:400:kworker.0 00000100:00100000:1.0:1788744330.279395:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744330.279475:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744330.279601:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744330.279663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465408 00000100:00100000:1.0:1788744330.279673:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465408 00000100:00100000:1.0:1788744330.279753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465280 00000100:00100000:1.0:1788744330.279757:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465280 00000100:00100000:1.0:1788744330.279778:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788744330.279787:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068465408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.281209:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788744330.281232:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068465280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.281331:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068465280:12345-0@lo:400:kworker.0 Request processed in 112us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744330.281338:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788744330.281385:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744330.281434:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00940700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068465280:0@lo:400:kworker.0 00000100:00100000:1.0:1788744330.281811:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068465408:12345-0@lo:400:kworker.0 Request processed in 2024us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744330.281818:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788744330.281925:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744330.281977:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068465664:0@lo:400:kworker.0 00000100:00100000:0.0:1788744330.282005:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744330.282041:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465664 00000100:00100000:0.0:1788744330.282057:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465664 00000100:00100000:0.0:1788744330.282104:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788744330.282111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068465664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.282366:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068465408:0@lo:400:kworker.0 00000100:00100000:1.0:1788744330.282591:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465152 00000100:00100000:1.0:1788744330.282596:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465152 00000100:00100000:1.0:1788744330.282635:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744330.282643:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068465152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744330.282691:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744330.282753:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068465152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744330.282760:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788744330.282790:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744330.282825:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace4cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068465152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744330.282931:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068465664:12345-0@lo:400:kworker.0 Request processed in 821us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744330.282937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788744330.283746:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068465664:0@lo:400:kworker.0 00000100:00100000:3.0:1788744330.289856:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744330.289944:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068465536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744330.289982:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744330.290270:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465536 00000100:00100000:0.0:1788744330.290280:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465536 00000100:00100000:0.0:1788744330.290364:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744330.290375:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068465536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744330.290454:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068465536:12345-0@lo:400:kworker.0 Request processed in 80us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744330.290462:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744330.290973:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788744330.290981:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788744330.291009:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff940afa5cf100 x1875634068464896/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788744342 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744330.291024:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068465536:0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.291344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465024 00000100:00100000:2.0:1788744330.291352:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465024 00000100:00100000:2.0:1788744330.291396:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788744330.291406:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068465024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.291474:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068465024:12345-0@lo:400:kworker.0 Request processed in 71us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744330.292623:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00942d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068465024:0@lo:400:kworker.0 00000100:00100000:2.0:1788744330.292738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1788744330.292952:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744330.970868:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744331.291322:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744331.291350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068465920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744331.291431:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744331.291581:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068465920 00000100:00100000:3.0:1788744331.291592:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068465920 00000100:00100000:3.0:1788744331.291650:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788744331.291661:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068465920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744331.291713:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744331.291775:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068465920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744331.291782:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788744331.291854:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068465920:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788744331.601313:0:12255:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:25:29 (1788744329) 00000100:00100000:0.0:1788744331.761749:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744331.761786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744331.761805:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744331.761821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744331.761841:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744331.761867:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483264 00000100:00100000:0.0:1788744331.761877:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483264 00000100:00100000:0.0:1788744331.761932:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483392 00000100:00100000:0.0:1788744331.761935:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483392 00000100:00100000:0.0:1788744331.761958:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:0.0:1788744331.761967:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047483264:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744331.762031:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047483264:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744331.762049:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:0.0:1788744331.762067:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:0.0:1788744331.762072:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047483392:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744331.762093:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+5:2352:x1875634047483392:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 21us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744331.762099:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:0.0:1788744331.762116:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483520 00000100:00100000:0.0:1788744331.762120:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483520 00000100:00100000:0.0:1788744331.762146:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483136 00000100:00100000:0.0:1788744331.762149:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483136 00000100:00100000:0.0:1788744331.762166:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 166 00000100:00100000:0.0:1788744331.762172:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047483520:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744331.762198:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047483520:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744331.762205:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 166 00000100:00100000:0.0:1788744331.762216:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00100000:0.0:1788744331.762221:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+14:2352:x1875634047483136:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744331.762242:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+14:2352:x1875634047483136:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 21us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744331.762248:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00080000:0.0:1788744331.762265:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788744331.762270:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744331.762271:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744331.762670:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483008 00000100:00100000:1.0:1788744331.762676:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483008 00000100:00100000:1.0:1788744331.762722:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 302 00000100:00100000:1.0:1788744331.762730:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047483008:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744331.762766:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2352:x1875634047483008:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 36us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744331.762772:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 302 00000001:00080000:2.0:1788744331.878867:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000020:00080000:0.0:1788744331.901668:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788744331.901708:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788744331.901785:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788744331.901798:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788744331.995020:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744333.019300:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744333.077059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744333.077159:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483776 00000100:00100000:0.0:1788744333.077169:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483776 00000100:00100000:0.0:1788744333.077242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 136 00000100:00100000:0.0:1788744333.077253:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+13:11287:x1875634047483776:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744333.077278:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744333.077297:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f6f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761357 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077361:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077375:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077386:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077431:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077439:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077445:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077706:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f84 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077715:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.077729:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f84 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744333.077740:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00080000:3.0:1788744333.077888:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788744333.078046:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078054:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078062:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078069:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744333.078072:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078079:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078091:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ac3570c00) 00010000:00010000:0.0:1788744333.078093:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744333.078098:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078104:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94f76 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078115:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078121:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078133:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078138:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744333.078141:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078148:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078154:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff940ad90af300) 00010000:00010000:0.0:1788744333.078156:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744333.078159:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078165:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94f7d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078729:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94f6f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761357 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078745:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f84 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761357 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744333.078926:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:0.0:1788744333.078929:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744333.078931:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:0.0:1788744333.078997:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+15:11287:x1875634047483776:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1745us (1948us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788744333.079014:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 136 00000100:00100000:1.0:1788744333.083083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744333.083507:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047483904 00000100:00100000:2.0:1788744333.083518:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047483904 00000100:00100000:2.0:1788744333.083604:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744333.083614:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+15:2351:x1875634047483904:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744333.083629:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744333.083654:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94f84 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761357 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744333.083686:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:2.0:1788744333.083691:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744333.083759:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+14:2351:x1875634047483904:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 146us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744333.083766:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:1.0:1788744333.085335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744333.086561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484032 00000100:00100000:2.0:1788744333.086641:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484032 00000100:00100000:2.0:1788744333.088267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 137 00000100:00100000:2.0:1788744333.088289:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:11287:x1875634047484032:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788744333.088486:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:11287:x1875634047484032:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 Request processed in 207us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744333.088496:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 137 00000040:00080000:1.0:1788744333.917792:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744333.917803:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744333.918266:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788744333.918274:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788744334.042743:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744335.068485:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744335.157084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744335.157161:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484160 00000100:00100000:1.0:1788744335.157177:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484160 00000100:00100000:1.0:1788744335.157254:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 138 00000100:00100000:1.0:1788744335.157265:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+14:11329:x1875634047484160:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744335.157284:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744335.157305:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94f92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576135e expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157375:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157390:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157402:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157416:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157423:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157428:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157699:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157708:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157715:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157727:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744335.157731:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157738:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157751:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:1.0:1788744335.157754:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744335.157759:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157765:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b94f99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157791:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157797:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157803:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157809:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744335.157812:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157818:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157838:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff940ac3570a00) 00010000:00010000:1.0:1788744335.157840:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744335.157843:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157849:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b94fa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157881:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94f92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576135e expref: 15 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157892:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:1.0:1788744335.157894:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744335.157898:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b94f92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576135e expref: 15 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.157906:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2800, rc 0) 00000100:00100000:1.0:1788744335.157978:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+14:11329:x1875634047484160:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 715us (904us total) trans 0 rc 301/301 00000100:00100000:1.0:1788744335.157986:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 138 00000100:00080000:3.0:1788744335.158421:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744335.169697:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.169867:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484416 00000100:00100000:2.0:1788744335.169878:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484416 00000100:00100000:2.0:1788744335.169943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 139 00000100:00100000:2.0:1788744335.169953:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+14:11329:x1875634047484416:12345-192.168.204.56@tcp:36:lfs.0 00010000:00010000:2.0:1788744335.170011:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744335.170040:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9491e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576119e expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170063:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad8818e00) 00010000:00010000:2.0:1788744335.170074:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744335.170308:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170323:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170334:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170346:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170364:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.170371:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744335.172244:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744335.172264:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172273:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172280:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172286:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744335.172290:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172298:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172317:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc100) 00010000:00010000:2.0:1788744335.172321:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744335.172325:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.172332:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fa7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744335.172373:0:5837:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cad0c273 reply state 00000000c95c3b60 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744335.172382:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744335.172522:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+15:11329:x1875634047484416:12345-192.168.204.56@tcp:36:lfs.0 Request processed in 2565us (2830us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788744335.172535:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 139 00010000:00010000:3.0:1788744335.189020:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189039:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189048:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189054:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744335.189059:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189069:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189091:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff940ac2bbc300) 00010000:00010000:3.0:1788744335.189094:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744335.189100:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.189127:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b94fae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744335.305893:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.307900:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484544 00000100:00100000:2.0:1788744335.307920:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484544 00000100:00100000:2.0:1788744335.307986:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 140 00000100:00100000:2.0:1788744335.307997:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:11337:x1875634047484544:12345-192.168.204.56@tcp:101:lctl.0 00010000:00010000:2.0:1788744335.308030:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744335.308058:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761365 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308141:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308158:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308172:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744335.308224:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744335.308229:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744335.308259:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308311:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b94fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761365 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308330:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761365 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.308339:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744335.308343:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744335.308348:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389c00, rc 0) 00000100:00100000:2.0:1788744335.308497:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+15:11337:x1875634047484544:12345-192.168.204.56@tcp:101:lctl.0 Request processed in 501us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744335.311032:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 140 00000100:00100000:1.0:1788744335.387166:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068466048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788744335.387240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744335.387337:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466048 00000100:00100000:1.0:1788744335.387345:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466048 00000100:00100000:1.0:1788744335.387401:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788744335.387425:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068466048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744335.387466:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744335.387508:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068466048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744335.387514:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788744335.387545:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744335.387602:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068466048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744335.391946:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068466432:0@lo:400:kworker.0 00000100:00100000:3.0:1788744335.392017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744335.392061:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744335.392066:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068466304:0@lo:400:kworker.0 00000100:00100000:3.0:1788744335.392083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744335.392239:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466432 00000100:00100000:0.0:1788744335.392252:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466432 00000100:00100000:0.0:1788744335.392345:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466304 00000100:00100000:0.0:1788744335.392349:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466304 00000100:00100000:0.0:1788744335.392372:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788744335.392380:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068466432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744335.392439:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068466432:12345-0@lo:400:kworker.0 Request processed in 59us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.392446:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788744335.392467:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744335.392473:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744335.392496:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068466304:12345-0@lo:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.392502:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788744335.392537:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068466304:0@lo:400:kworker.0 00000100:00100000:0.0:1788744335.392578:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068466432:0@lo:400:kworker.0 00000100:00080000:3.0:1788744335.393325:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744335.393903:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068466560:0@lo:400:kworker.0 00000100:00100000:2.0:1788744335.393969:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744335.394032:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744335.394039:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068466176:0@lo:400:kworker.0 00000100:00100000:2.0:1788744335.394067:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744335.394101:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068466688:0@lo:400:kworker.0 00000100:00100000:2.0:1788744335.394123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744335.394155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466688 00000100:00100000:2.0:1788744335.394162:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466688 00000100:00100000:2.0:1788744335.394210:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788744335.394218:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068466688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744335.394262:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068466688:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744335.394284:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788744335.394303:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744335.394325:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068466688:0@lo:400:kworker.0 00000100:00100000:3.0:1788744335.394410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466176 00000100:00100000:3.0:1788744335.394416:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466176 00000100:00100000:3.0:1788744335.394455:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788744335.394462:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068466176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744335.394499:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068466176:12345-0@lo:400:kworker.0 Request processed in 39us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744335.394505:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788744335.394600:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068466176:0@lo:400:kworker.0 00000100:00100000:0.0:1788744335.394684:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068466560 00000100:00100000:0.0:1788744335.394689:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068466560 00000100:00100000:0.0:1788744335.395005:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744335.395012:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068466560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744335.395061:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068466560:12345-0@lo:400:kworker.0 Request processed in 50us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.395075:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788744335.395108:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788744335.395114:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940afa5cf100, transno 4294967313 00000100:00100000:0.0:1788744335.395124:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068466560:0@lo:400:kworker.0 00000100:00080000:2.0:1788744335.397414:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744335.404128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.404242:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484672 00000100:00100000:2.0:1788744335.404253:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484672 00000100:00100000:0.0:1788744335.404399:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 141 00000100:00100000:0.0:1788744335.404413:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+15:11343:x1875634047484672:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744335.404434:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.404456:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576136c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404532:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404545:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404599:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404628:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404636:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404643:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404951:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404960:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.404968:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744335.404996:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788744335.405000:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744335.405020:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405032:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405038:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405045:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405051:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.405056:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405063:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405078:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:0.0:1788744335.405087:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.405094:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405101:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405118:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405125:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405131:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405137:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.405140:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405145:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405152:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff940ad90af000) 00010000:00010000:0.0:1788744335.405155:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.405158:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405163:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576136c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405222:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576136c expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.405230:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744335.405232:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788744335.405235:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296800, rc 0) 00000100:00100000:0.0:1788744335.405304:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+16:11343:x1875634047484672:12345-192.168.204.56@tcp:101:bash.0 Request processed in 894us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.405782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 141 00000100:00100000:3.0:1788744335.410530:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.411265:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047484928 00000100:00100000:0.0:1788744335.411277:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047484928 00000100:00100000:0.0:1788744335.411408:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 142 00000100:00100000:0.0:1788744335.411421:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+16:11343:x1875634047484928:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744335.411442:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.411463:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94fdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761373 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411626:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411641:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411652:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411727:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411748:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.411755:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744335.413028:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788744335.413255:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413270:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413281:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413479:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413487:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413495:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413502:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.413507:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413648:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413679:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744335.413682:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.413689:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413695:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297000/0x7cd2bfd5e1b94fe6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744335.413833:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000feea3d81 reply state 00000000dd5c8e80 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.413844:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788744335.413884:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b94fdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 19 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413899:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 18 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.413906:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:0.0:1788744335.413908:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744335.413911:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296e00, rc 0) 00000100:00100000:0.0:1788744335.414260:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+19:11343:x1875634047484928:12345-192.168.204.56@tcp:101:bash.0 Request processed in 2840us (3749us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788744335.414270:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 142 00010000:00010000:2.0:1788744335.420032:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420054:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420062:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420068:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744335.420072:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420080:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420099:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af000) 00010000:00010000:2.0:1788744335.420102:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744335.420107:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.420114:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b94fed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.422024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.422703:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047485056 00000100:00100000:0.0:1788744335.422723:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047485056 00000100:00100000:0.0:1788744335.422848:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:0.0:1788744335.422860:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047485056:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744335.422895:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.422920:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576137a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744335.422951:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744335.422974:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:0.0:1788744335.422979:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744335.422988:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.423007:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.423020:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297400, rc 0) 00000100:00100000:0.0:1788744335.423085:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047485056:12345-192.168.204.56@tcp:101:bash.0 Request processed in 227us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.423092:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00080000:3.0:1788744335.425469:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744335.427191:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.427304:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047485184 00000100:00100000:0.0:1788744335.427378:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047485184 00000100:00100000:0.0:1788744335.427482:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:0.0:1788744335.427494:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:11343:x1875634047485184:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744335.427516:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.427537:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761381 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.427864:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.427886:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744335.427891:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744335.427898:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.427940:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.427955:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 7 pid: 6681 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.427970:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068466816:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744335.428111:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744335.432176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.432268:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047485312 00000100:00100000:3.0:1788744335.432281:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047485312 00010000:00010000:3.0:1788744335.432357:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 8 pid: 6681 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.432417:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:3.0:1788744335.432434:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047485312:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744335.432480:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744335.432507:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 8 pid: 6681 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.432521:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 8 pid: 6681 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.432603:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744335.432609:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744335.432627:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.432639:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.432701:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.432728:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068466944:192.168.204.56@tcp:105: 00000100:00100000:3.0:1788744335.432815:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac663b900 going to sleep for 11 seconds 00010000:00010000:0.0:1788744335.434960:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d93e69f/0x7cd2bfd5e1b95002 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576137a expref: 8 pid: 6681 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.434989:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068466816:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744335.435029:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.435046:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7297000, rc 0) 00000100:00100000:3.0:1788744335.436762:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068466944:192.168.204.56@tcp:105: 00010000:00010000:3.0:1788744335.436799:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744335.436866:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa486d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047485312:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 4434us (4703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744335.436878:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:1.0:1788744335.439112:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:11343:x1875634047485184:12345-192.168.204.56@tcp:101:bash.0 Request processed in 11606us (11917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744335.439125:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:2.0:1788744335.444268:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.444452:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047485568 00000100:00100000:0.0:1788744335.444469:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047485568 00000100:00100000:1.0:1788744335.444732:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:1.0:1788744335.444746:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+18:11343:x1875634047485568:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:1.0:1788744335.445521:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:11343:x1875634047485568:12345-192.168.204.56@tcp:35:bash.0 Request processed in 773us (1263us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788744335.445532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:1.0:1788744335.562181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.562361:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047485824 00000100:00100000:2.0:1788744335.562375:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047485824 00000100:00100000:2.0:1788744335.562452:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 143 00000100:00100000:2.0:1788744335.562461:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+19:11353:x1875634047485824:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744335.562485:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744335.562507:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761388 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744335.563053:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788744335.563187:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95010 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761388 expref: 21 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.563202:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744335.563205:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744335.563211:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761388 expref: 21 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.563227:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744335.563346:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+20:11353:x1875634047485824:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 885us (1177us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788744335.563354:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 143 00000100:00100000:1.0:1788744335.574326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.574404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486080 00000100:00100000:3.0:1788744335.574417:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486080 00000100:00100000:3.0:1788744335.574485:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:3.0:1788744335.574498:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+20:11353:x1875634047486080:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744335.574847:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+21:11353:x1875634047486080:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 351us (541us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788744335.574855:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:1.0:1788744335.664674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.665032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486208 00000100:00100000:3.0:1788744335.665045:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486208 00000100:00100000:3.0:1788744335.665109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 144 00000100:00100000:3.0:1788744335.665120:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+21:11359:x1875634047486208:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744335.665144:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744335.665166:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9501e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576138f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665239:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665255:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665266:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744335.665381:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788744335.665386:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744335.665409:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665436:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9501e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576138f expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665475:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576138f expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.665484:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744335.665487:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744335.665491:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f200, rc 0) 00000100:00100000:3.0:1788744335.666163:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:11359:x1875634047486208:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1040us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744335.666171:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 144 00000100:00100000:2.0:1788744335.673159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.673250:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486464 00000100:00100000:0.0:1788744335.673275:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486464 00000100:00100000:0.0:1788744335.673430:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 145 00000100:00100000:0.0:1788744335.673443:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+22:11359:x1875634047486464:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744335.673465:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.673492:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9502c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761396 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.673934:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b95033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.673950:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b95033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.673960:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b95033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744335.673973:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788744335.674102:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297400/0x7cd2bfd5e1b9502c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761396 expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.674122:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b95033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761396 expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.674130:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:0.0:1788744335.674133:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744335.674136:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7296c00, rc 0) 00000100:00100000:0.0:1788744335.674250:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+24:11359:x1875634047486464:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 809us (1103us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788744335.674257:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 145 00000100:00100000:2.0:1788744335.679642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.679683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.679779:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486720 00000100:00100000:0.0:1788744335.679789:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486720 00000100:00100000:0.0:1788744335.679846:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 146 00000100:00100000:0.0:1788744335.679856:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+24:11359:x1875634047486720:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744335.679884:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.679936:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95041 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576139d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.680620:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486848 00000100:00100000:3.0:1788744335.680628:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486848 00000100:00100000:3.0:1788744335.680676:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:3.0:1788744335.680685:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:2353:x1875634047486848:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744335.680707:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744335.680734:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296c00/0x7cd2bfd5e1b95033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761396 expref: 26 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.680764:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:3.0:1788744335.680770:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744335.680906:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.680925:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.680938:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744335.680954:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788744335.681124:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95041 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576139d expref: 27 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.681139:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576139d expref: 26 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.681147:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:0.0:1788744335.681149:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788744335.681152:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77400, rc 0) 00000100:00100000:3.0:1788744335.681971:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:2353:x1875634047486848:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 1280us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744335.681984:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:0.0:1788744335.682090:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+25:11359:x1875634047486720:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 2234us (2459us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788744335.682121:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 146 00000100:00100000:2.0:1788744335.689885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.690023:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047486976 00000100:00100000:3.0:1788744335.690035:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047486976 00000100:00100000:3.0:1788744335.690096:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:3.0:1788744335.690114:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047486976:12345-192.168.204.56@tcp:1:lfs.0 00010000:00010000:3.0:1788744335.690167:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.690187:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.690196:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744335.690202:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744335.690207:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.690244:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.690258:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 6 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.690271:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875634068467072:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744335.690435:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac663b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744335.698137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.698295:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047487104 00000100:00100000:2.0:1788744335.698395:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047487104 00002000:00100000:2.0:1788744335.698480:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff940afa486300 x1875634047487104/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:611/0 lens 504/0 e 0 to 0 dl 1788744346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744335.698492:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa486300 with x1875634047487104 ext(0->12) 00010000:00010000:2.0:1788744335.698503:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 7 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.698527:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 7 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744335.698537:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940afa486300 00000100:00100000:2.0:1788744335.698708:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744335.698720:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047487104:12345-192.168.204.56@tcp:4:lfs.0 00000100:00100000:2.0:1788744335.699423:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa486300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047487104:12345-192.168.204.56@tcp:4:lfs.0 Request processed in 703us (1308us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788744335.699431:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00002000:00100000:2.0:1788744335.699439:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff940afa486300 x1875634047487104/t4294967305(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:611/0 lens 504/448 e 0 to 0 dl 1788744346 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744335.699448:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa486300 with x1875634047487104 ext(0->12) 00010000:00010000:2.0:1788744335.699455:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.699468:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744335.699486:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940afa486300 00000100:00100000:3.0:1788744335.703951:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875634068467072:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744335.703985:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744335.704444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744335.705022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047487232 00000100:00100000:2.0:1788744335.705244:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047487232 00010000:00010000:2.0:1788744335.705296:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744335.705475:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:2.0:1788744335.705488:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2351:x1875634047487232:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744335.705508:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788744335.705533:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788744335.705536:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788744335 00002000:00010000:2.0:1788744335.705540:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788744335 00002000:00010000:2.0:1788744335.705543:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788744335 00010000:00010000:2.0:1788744335.705588:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.705602:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.705637:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7da8803/0x7cd2bfd5e1b95009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761381 expref: 9 pid: 6682 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.705657:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744335.705662:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744335.705669:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.705709:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744335.705747:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744335.706007:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2351:x1875634047487232:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 520us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744335.706015:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 61 00010000:00010000:0.0:1788744335.706090:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706100:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706129:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706138:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706146:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706154:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744335.706159:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706167:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706179:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.706202:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e923b4c4/0x7cd2bfd5e1b95056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.706258:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047486976:12345-192.168.204.56@tcp:1:lfs.0 Request processed in 16146us (16385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.706266:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:1.0:1788744335.710138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.710244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047487488 00000100:00100000:3.0:1788744335.710255:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047487488 00000100:00100000:1.0:1788744335.710502:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:1.0:1788744335.710512:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8697050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+25:11359:x1875634047487488:12345-192.168.204.56@tcp:35:lfs.0 00000004:00010000:1.0:1788744335.710739:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576139d expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744335.711223:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788744335.711269:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788744335.713445:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788744335.713825:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.713850:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 29 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.713860:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.713910:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 29 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744335.713930:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 29 pid: 6704 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744335.713948:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa484a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068467200:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744335.714184:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744335.719100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.719229:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa484a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068467200:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744335.719269:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.719408:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047487616 00000100:00100000:0.0:1788744335.719419:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047487616 00010000:00010000:0.0:1788744335.719463:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 30 pid: 6704 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.719509:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:0.0:1788744335.719519:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+30:2354:x1875634047487616:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744335.719537:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744335.719546:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 30 pid: 6704 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719588:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 30 pid: 6704 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719625:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296e00/0x7cd2bfd5e1b94ff4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761373 expref: 30 pid: 6704 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719645:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:0.0:1788744335.719650:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719673:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719681:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.719733:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744335.720269:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+29:2354:x1875634047487616:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 748us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.720278:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00010000:00010000:0.0:1788744335.720324:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.720333:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744335.720530:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788744335.721396:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788744335.721639:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068467328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788744335.722122:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744335.722160:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744335.722275:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068467328 00000100:00100000:3.0:1788744335.722286:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068467328 00000100:00100000:3.0:1788744335.722344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744335.722357:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068467328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744335.722469:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068467328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744335.722476:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744335.722527:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068467328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788744335.723210:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788744335.723307:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068467456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744335.723358:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744335.723383:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744335.723410:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068467456 00000100:00100000:3.0:1788744335.723417:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068467456 00000100:00100000:3.0:1788744335.723447:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744335.723455:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068467456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788744335.723700:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875634068467456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 245us (340us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788744335.723708:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744335.723749:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068467456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788744335.723798:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788744335.723841:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723863:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723874:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723882:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744335.723889:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723899:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723924:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:3.0:1788744335.723929:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788744335.723935:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.723941:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9505d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744335.724122:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788744335.724351:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788744335.724366:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407856815438ns, next at 408856812828ns, rc = 0 00000001:00080000:3.0:1788744335.724373:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788744335.724407:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af700) 00010000:00010000:3.0:1788744335.724410:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788744335.724417:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95048 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576139d expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744335.731887:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8697050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:11359:x1875634047487488:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 21353us (21737us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788744335.731910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00000020:00080000:3.0:1788744335.731922:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788744335.733209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.733365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047487744 00000100:00100000:3.0:1788744335.733378:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047487744 00000100:00100000:0.0:1788744335.734012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 147 00000100:00100000:0.0:1788744335.734027:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:11359:x1875634047487744:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744335.734064:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.734106:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95064 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613a4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.734199:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95064 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613a4 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.734237:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95064 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613a4 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.734261:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744335.734265:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744335.734268:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77c00, rc 0) 00000100:00100000:0.0:1788744335.734357:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+33:11359:x1875634047487744:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 334us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.734364:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 147 00000100:00100000:2.0:1788744335.739914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744335.740144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047488000 00000100:00100000:1.0:1788744335.740158:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047488000 00000100:00100000:1.0:1788744335.743460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:1.0:1788744335.743494:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+33:11359:x1875634047488000:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744335.746214:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+34:11359:x1875634047488000:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 2068us (5647us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788744335.746232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:1.0:1788744335.854989:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.855155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047488256 00000100:00100000:3.0:1788744335.855168:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047488256 00000100:00100000:3.0:1788744335.855236:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 148 00000100:00100000:3.0:1788744335.855248:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+34:11369:x1875634047488256:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744335.855285:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744335.855311:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9506b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744335.855405:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788744335.855532:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9506b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ab expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.855586:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:3.0:1788744335.855590:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744335.855596:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9506b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ab expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744335.855622:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f000, rc 0) 00000100:00100000:3.0:1788744335.855838:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+35:11369:x1875634047488256:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 591us (868us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1788744335.855860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 148 00000100:00100000:2.0:1788744335.861386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.861783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047488384 00000100:00100000:0.0:1788744335.861800:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047488384 00000100:00100000:0.0:1788744335.861887:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 149 00000100:00100000:0.0:1788744335.861901:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+35:11369:x1875634047488384:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:0.0:1788744335.862010:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862028:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862040:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862058:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862065:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862092:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862217:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862225:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862232:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744335.862282:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862295:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862301:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862309:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862314:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.862320:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862329:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862343:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744335.862353:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.862362:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862370:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b95079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862386:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862392:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862399:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862404:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.862408:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862414:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862420:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af800) 00010000:00010000:0.0:1788744335.862423:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.862425:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862431:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862447:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862457:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862463:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862468:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.862471:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862477:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862484:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744335.862486:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.862489:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.862495:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b95087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.862945:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+35:11369:x1875634047488384:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1045us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.862956:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 149 00000100:00100000:2.0:1788744335.865741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744335.866094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047488640 00000100:00100000:3.0:1788744335.866108:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047488640 00000100:00100000:3.0:1788744335.866179:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:3.0:1788744335.866191:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:11369:x1875634047488640:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744335.866492:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+36:11369:x1875634047488640:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 303us (763us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788744335.866501:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:3.0:1788744335.962002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.962161:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047488896 00000100:00100000:0.0:1788744335.962171:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047488896 00000100:00100000:0.0:1788744335.962238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 150 00000100:00100000:0.0:1788744335.962248:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+36:11372:x1875634047488896:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744335.962290:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744335.962329:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9508e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613b2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962424:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962440:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962454:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962467:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962473:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962479:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962968:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962980:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.962988:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744335.963000:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788744335.963117:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963138:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963145:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963151:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.963156:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963164:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963176:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744335.963179:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.963184:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963190:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963203:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963208:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963214:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963218:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.963226:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963232:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963239:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af800) 00010000:00010000:0.0:1788744335.963242:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744335.963244:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963250:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b9509c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963321:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9508e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963335:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.963342:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744335.963344:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744335.963347:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77600, rc 0) 00000100:00100000:0.0:1788744335.966762:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+38:11372:x1875634047488896:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 4491us (4751us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788744335.966776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 150 00000100:00100000:2.0:1788744335.989917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744335.990037:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047489024 00000100:00100000:0.0:1788744335.990048:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047489024 00000100:00100000:0.0:1788744335.990124:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 151 00000100:00100000:0.0:1788744335.990137:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+38:11372:x1875634047489024:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:0.0:1788744335.990222:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990242:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990256:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990284:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990291:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990298:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990303:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744335.990308:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990315:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990328:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744335.990332:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744335.990337:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744335.990344:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b950b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744335.990435:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+38:11372:x1875634047489024:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 300us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744335.990442:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 151 00000100:00100000:2.0:1788744335.995499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744335.995962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047489280 00000100:00100000:1.0:1788744335.995983:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047489280 00000100:00100000:1.0:1788744335.996081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:1.0:1788744335.996094:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+38:11372:x1875634047489280:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744335.996433:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+39:11372:x1875634047489280:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 341us (952us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788744335.996441:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 41 00010000:00010000:1.0:1788744336.092217:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744336.276841:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744336.277246:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047489536 00000100:00100000:2.0:1788744336.277257:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047489536 00000100:00100000:2.0:1788744336.277324:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 152 00000100:00100000:2.0:1788744336.277335:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+39:11403:x1875634047489536:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:2.0:1788744336.277362:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744336.277689:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613b9 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.277947:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.277963:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.277994:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744336.278008:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788744336.278167:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b9 expref: 42 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.278194:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b9 expref: 41 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.278204:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:2.0:1788744336.278207:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744336.278212:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388400, rc 0) 00000100:00100000:2.0:1788744336.278390:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+41:11403:x1875634047489536:12345-192.168.204.56@tcp:101:cat.0 Request processed in 1056us (1556us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788744336.278398:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 152 00000100:00100000:2.0:1788744336.293232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744336.293279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744336.294045:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047489792 00000100:00100000:3.0:1788744336.294056:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047489792 00000100:00100000:3.0:1788744336.294120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:3.0:1788744336.294131:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+41:11403:x1875634047489792:12345-192.168.204.56@tcp:35:cat.0 00000100:00100000:3.0:1788744336.294413:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+42:11403:x1875634047489792:12345-192.168.204.56@tcp:35:cat.0 Request processed in 283us (1190us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788744336.294421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:1.0:1788744336.295326:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047489920 00000100:00100000:1.0:1788744336.295335:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047489920 00000100:00100000:1.0:1788744336.295407:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:1.0:1788744336.295416:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+42:2353:x1875634047489920:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744336.295430:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744336.295453:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b9 expref: 42 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.295471:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744336.295475:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744336.295519:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+41:2353:x1875634047489920:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 105us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.295525:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:2.0:1788744336.375804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744336.375914:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047490176 00000100:00100000:0.0:1788744336.375926:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047490176 00000100:00100000:0.0:1788744336.376032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 153 00000100:00100000:0.0:1788744336.376043:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+41:11409:x1875634047490176:12345-192.168.204.56@tcp:101:dd.0 00010000:00010000:0.0:1788744336.376067:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744336.376070:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788744336.376112:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95025 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576138f expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376135:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744336.376141:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744336.376157:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b950cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613c0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376255:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376270:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376279:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376315:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.376346:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 41 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744336.376359:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068467584:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744336.376460:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004180 going to sleep for 11 seconds 00000100:00100000:0.0:1788744336.384365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744336.384507:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068467584:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744336.384545:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744336.388535:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047490304 00000100:00100000:3.0:1788744336.388569:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047490304 00010000:00010000:3.0:1788744336.388633:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 42 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744336.388685:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:3.0:1788744336.388697:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+42:2354:x1875634047490304:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744336.388713:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744336.388735:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 42 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388751:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 42 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388776:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b950a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613b2 expref: 42 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388797:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744336.388803:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388815:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388823:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.388861:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744336.388944:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+41:2354:x1875634047490304:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 248us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744336.388954:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 63 00010000:00010000:2.0:1788744336.389579:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.389590:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744336.389637:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788744336.389812:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b950cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.389831:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.389839:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:2.0:1788744336.389841:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744336.389844:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77e00, rc 0) 00000100:00100000:2.0:1788744336.389898:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940affa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+41:11409:x1875634047490176:12345-192.168.204.56@tcp:101:dd.0 Request processed in 13857us (14106us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788744336.389906:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 153 00000100:00100000:0.0:1788744336.409185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744336.409365:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047490560 00000100:00100000:1.0:1788744336.409376:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047490560 00000100:00100000:1.0:1788744336.409448:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 154 00000100:00100000:1.0:1788744336.409459:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+41:11409:x1875634047490560:12345-192.168.204.56@tcp:36:dd.0 00010000:00010000:1.0:1788744336.409830:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.409850:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.409863:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744336.409919:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788744336.409945:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002f3cc8f6 reply state 00000000c68487e7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744336.409954:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744336.410057:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+44:11409:x1875634047490560:12345-192.168.204.56@tcp:36:dd.0 Request processed in 599us (886us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788744336.410065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 154 00000020:00080000:1.0:1788744336.410070:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744336.411373:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068467712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744336.411456:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744336.412141:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412153:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412161:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412168:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744336.412173:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412182:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412199:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744336.412202:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744336.412234:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744336.412241:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b950e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744336.412364:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068467712 00000100:00100000:1.0:1788744336.412372:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068467712 00000100:00100000:1.0:1788744336.412426:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788744336.412436:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068467712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744336.412477:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744336.413130:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068467712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 693us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.413139:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788744336.413364:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068467712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744336.865895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744336.866600:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047490688 00000100:00100000:2.0:1788744336.866615:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047490688 00000100:00100000:2.0:1788744336.866693:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 155 00000100:00100000:2.0:1788744336.866704:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+43:11423:x1875634047490688:12345-192.168.204.56@tcp:101:stat.0 00010000:00010000:2.0:1788744336.866730:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744336.866752:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b950e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613c7 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866838:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866868:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866905:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866920:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866927:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.866933:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.867041:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.867052:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.867061:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.867100:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.867116:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 44 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744336.867139:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068467840:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744336.867275:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744336.871150:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068467840:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744336.871198:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744336.874348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744336.874411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047490944 00000100:00100000:3.0:1788744336.874422:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047490944 00000100:00100000:3.0:1788744336.874540:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:3.0:1788744336.874575:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+45:5593:x1875634047490944:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744336.874969:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+46:5593:x1875634047490944:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 419us (630us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788744336.874991:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:3.0:1788744336.876932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744336.876977:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744336.877081:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491072 00000100:00100000:2.0:1788744336.877092:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491072 00000100:00100000:2.0:1788744336.877169:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 304 00000100:00100000:2.0:1788744336.877180:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047491072:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744336.877258:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2351:x1875634047491072:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 81us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744336.877265:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 304 00000100:00100000:1.0:1788744336.878134:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491328 00000100:00100000:1.0:1788744336.878148:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491328 00000100:00100000:3.0:1788744336.878400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744336.878428:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491584 00000100:00100000:3.0:1788744336.878432:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491584 00010000:00010000:3.0:1788744336.878464:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 46 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744336.878489:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:2.0:1788744336.878503:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2351:x1875634047491328:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744336.878606:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2351:x1875634047491328:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 107us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.878611:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:2.0:1788744336.878619:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:1.0:1788744336.878627:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+46:2354:x1875634047491584:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744336.878641:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744336.878651:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 46 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.878668:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 46 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744336.878675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:1.0:1788744336.878711:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b950d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c0 expref: 46 pid: 5837 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.878733:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00000100:00100000:2.0:1788744336.878767:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744336.878791:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491456 00000100:00100000:0.0:1788744336.878796:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491456 00000100:00100000:0.0:1788744336.878858:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 171 00000100:00100000:0.0:1788744336.878867:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047491456:12345-192.168.204.56@tcp:400:kworker.0 00010000:00010000:1.0:1788744336.878970:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.878983:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.878992:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879025:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744336.879054:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+45:2354:x1875634047491584:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 432us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.879061:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 64 00010000:00010000:1.0:1788744336.879116:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879138:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744336.879194:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000100:00080000:2.0:1788744336.879290:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744336.879379:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2352:x1875634047491456:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 512us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744336.879387:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 171 00000004:00200000:1.0:1788744336.879461:0:10823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744336.879490:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744336.879498:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491200 00000100:00100000:3.0:1788744336.879505:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491200 00010000:00010000:1.0:1788744336.879505:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879517:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879525:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879532:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.879538:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744336.879542:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744336.879574:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:3.0:1788744336.879582:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047491200:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744336.879682:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:2352:x1875634047491200:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 101us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744336.879689:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 82 00010000:00010000:1.0:1788744336.879989:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880003:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744336.880006:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744336.880011:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880031:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b950f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880046:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880052:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880059:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880064:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744336.880067:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880072:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880080:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac2bbc100) 00010000:00010000:1.0:1788744336.880083:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744336.880087:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880093:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b950f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744336.880121:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744336.880144:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b950e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c7 expref: 45 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880175:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c7 expref: 44 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744336.880184:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744336.880187:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744336.880190:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:1.0:1788744336.880484:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+44:11423:x1875634047490688:12345-192.168.204.56@tcp:101:stat.0 Request processed in 13781us (14638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744336.880492:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 155 00000100:00100000:2.0:1788744336.975827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744336.976324:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491840 00000100:00100000:3.0:1788744336.976337:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491840 00000100:00100000:3.0:1788744336.976416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 156 00000100:00100000:3.0:1788744336.976430:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+44:11430:x1875634047491840:12345-192.168.204.56@tcp:36:truncate.0 00010000:00010000:3.0:1788744336.976513:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744336.976618:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b950fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613c7 expref: 44 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.976643:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744336.976651:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744336.977626:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.977645:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744336.977657:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744336.977716:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788744336.977741:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d22cb4d8 reply state 00000000d07f659c transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744336.977750:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744336.978997:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+46:11430:x1875634047491840:12345-192.168.204.56@tcp:36:truncate.0 Request processed in 2561us (3181us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788744336.979010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 156 00000020:00080000:3.0:1788744336.979018:0:5838:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788744336.985872:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.985892:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.986277:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.986296:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744336.986303:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.986314:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.986335:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:2.0:1788744336.986339:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744336.986344:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744336.986351:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95105 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744336.987727:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744336.987735:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744336.988793:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788744336.988802:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788744337.005358:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:0.0:1788744337.005412:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000001:00080000:0.0:1788744337.005481:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000004:00080000:0.0:1788744337.005503:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788744337.005529:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ac663b0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788744337.005534:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940af75e4f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ac663b900 00000020:00080000:0.0:1788744337.005538:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940af75e4400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940ace4ab800 00000020:00080000:0.0:1788744337.005735:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788744337.006084:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788744337.006105:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068467968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788744337.006181:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744337.006700:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068467968 00000100:00100000:1.0:1788744337.006712:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068467968 00000100:00100000:1.0:1788744337.006792:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788744337.006803:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875634068467968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788744337.006840:0:6680:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00080000:2.0:1788744337.006859:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788744337.006885:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e128f, atime: 0x6a9e128f, ctime: 0x6a9e128f, blocks: 0x1 00010000:00010000:1.0:1788744337.006894:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.006913:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:1.0:1788744337.006918:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744337.006925:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.006957:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.006968:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.006976:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.007002:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744337.007063:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744337.007072:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.007083:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744337.007088:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.007100:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.007120:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.007128:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eadcb0e2/0x7cd2bfd5e1b9510c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.007156:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744337.007160:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744337.007162:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744337.008155:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068467968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1349us (1968us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788744337.008168:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:0.0:1788744337.008219:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940af6e2ce00/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788744337.008228:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068467968:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788744337.119763:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744337.248059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744337.248130:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047491968 00000100:00100000:0.0:1788744337.248144:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047491968 00000100:00080000:2.0:1788744337.248238:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744337.248245:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 157 00000100:00100000:0.0:1788744337.248258:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+17:11444:x1875634047491968:12345-192.168.204.56@tcp:101:stat.0 00010000:00010000:0.0:1788744337.248290:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744337.248331:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95113 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613ce expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248401:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248416:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248428:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248443:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248463:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.248470:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249075:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249087:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249095:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744337.249143:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788744337.249148:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744337.249175:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249196:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249204:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249211:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249218:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249223:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744337.249228:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249236:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249248:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744337.249251:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744337.249256:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249262:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b9511a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249276:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249282:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249296:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249301:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744337.249304:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249310:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249318:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af800) 00010000:00010000:0.0:1788744337.249320:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744337.249323:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249328:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249365:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95113 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249378:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.249386:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:0.0:1788744337.249388:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744337.249391:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76c00, rc 0) 00000100:00100000:0.0:1788744337.249746:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+18:11444:x1875634047491968:12345-192.168.204.56@tcp:101:stat.0 Request processed in 1489us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744337.249765:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 157 00000100:00100000:3.0:1788744337.384967:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.385058:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047492224 00000100:00100000:1.0:1788744337.385069:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047492224 00000100:00100000:1.0:1788744337.385141:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 158 00000100:00100000:1.0:1788744337.385153:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+18:11454:x1875634047492224:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744337.385177:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744337.385202:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9512f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613d5 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744337.385302:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788744337.385688:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9512f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613d5 expref: 20 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.385722:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:1.0:1788744337.385724:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744337.385730:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9512f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613d5 expref: 20 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.385747:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3600, rc 0) 00000100:00100000:1.0:1788744337.385818:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+19:11454:x1875634047492224:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 667us (862us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788744337.385826:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 158 00000100:00100000:3.0:1788744337.393889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744337.393989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047492480 00000100:00100000:2.0:1788744337.394000:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047492480 00000100:00100000:2.0:1788744337.394081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:2.0:1788744337.394092:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8695050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:11454:x1875634047492480:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744337.394386:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8695050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:11454:x1875634047492480:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 277us (488us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788744337.394395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:2.0:1788744337.471927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.472018:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047492736 00000100:00100000:3.0:1788744337.472029:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047492736 00000100:00100000:3.0:1788744337.472101:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 159 00000100:00100000:3.0:1788744337.472113:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+20:11460:x1875634047492736:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:3.0:1788744337.472142:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744337.472164:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9513d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.472286:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.472323:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.472333:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.472371:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.472387:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 21 pid: 5836 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744337.472404:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1875634068468096:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744337.472534:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744337.475333:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5838:1875634068468096:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744337.475371:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744337.475806:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.475977:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047492864 00000100:00100000:3.0:1788744337.475984:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047492864 00010000:00010000:3.0:1788744337.476021:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 22 pid: 5836 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744337.476057:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:3.0:1788744337.476065:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:2354:x1875634047492864:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744337.476077:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744337.476094:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 22 pid: 5836 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476103:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 22 pid: 5836 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476122:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ce expref: 22 pid: 5836 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476134:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744337.476138:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476145:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476150:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.476215:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744337.476260:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+21:2354:x1875634047492864:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 196us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744337.476265:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 65 00010000:00010000:1.0:1788744337.477341:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.477354:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744337.477396:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788744337.477636:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b9513d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.477657:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.477665:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744337.477668:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744337.477671:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164ee00, rc 0) 00000100:00100000:1.0:1788744337.477734:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+21:11460:x1875634047492736:12345-192.168.204.56@tcp:101:bash.0 Request processed in 5622us (5819us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788744337.477758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 159 00000100:00100000:2.0:1788744337.480033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744337.480164:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047493120 00000100:00100000:0.0:1788744337.480176:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047493120 00000100:00100000:0.0:1788744337.480240:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 160 00000100:00100000:0.0:1788744337.480250:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+21:11460:x1875634047493120:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:0.0:1788744337.480596:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.480614:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.480626:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744337.480847:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788744337.480874:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b6102f1f reply state 00000000481610b5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744337.480882:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744337.480965:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:11460:x1875634047493120:12345-192.168.204.56@tcp:36:bash.0 Request processed in 715us (940us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788744337.480972:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 160 00000020:00080000:0.0:1788744337.480977:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744337.483007:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483025:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483033:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483063:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744337.483071:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483080:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483103:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744337.483106:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744337.483112:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.483118:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b95152 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744337.489789:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.490059:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047493248 00000100:00100000:3.0:1788744337.490075:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047493248 00000100:00100000:3.0:1788744337.490148:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 161 00000100:00100000:3.0:1788744337.490159:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+23:11460:x1875634047493248:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:3.0:1788744337.490185:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744337.490206:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95159 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613e3 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.490301:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.490319:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.490352:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.490393:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.490407:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 24 pid: 5838 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744337.490422:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068468224:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744337.491950:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744337.516779:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068468224:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744337.516828:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744337.525316:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.528655:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047493376 00000100:00100000:3.0:1788744337.528682:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047493376 00010000:00010000:3.0:1788744337.528747:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 25 pid: 5838 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744337.528806:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:3.0:1788744337.528817:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+25:2353:x1875634047493376:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744337.528831:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744337.528838:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 25 pid: 5838 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528874:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 25 pid: 5838 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528901:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95144 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613dc expref: 25 pid: 5838 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528922:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744337.528927:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528937:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528946:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.528966:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744337.529032:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:2353:x1875634047493376:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 216us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744337.529039:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 66 00010000:00010000:2.0:1788744337.537159:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.537178:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744337.537235:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788744337.537239:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744337.537260:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.537307:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95159 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613e3 expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.537331:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613e3 expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.537342:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:2.0:1788744337.537345:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744337.537351:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164f200, rc 0) 00000100:00100000:2.0:1788744337.539052:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+23:11460:x1875634047493248:12345-192.168.204.56@tcp:101:bash.0 Request processed in 48880us (49262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744337.539067:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 161 00000100:00100000:0.0:1788744337.556953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744337.557473:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047493632 00000100:00100000:2.0:1788744337.557487:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047493632 00000100:00100000:2.0:1788744337.558203:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:2.0:1788744337.558220:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:11460:x1875634047493632:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:2.0:1788744337.558481:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:11460:x1875634047493632:12345-192.168.204.56@tcp:35:bash.0 Request processed in 267us (1540us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788744337.558505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:0.0:1788744337.640050:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.640218:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047493888 00000100:00100000:1.0:1788744337.640230:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047493888 00000100:00100000:1.0:1788744337.640297:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 162 00000100:00100000:1.0:1788744337.640307:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+24:11470:x1875634047493888:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744337.640336:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744337.640356:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744337.640458:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788744337.640643:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95167 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ea expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.640667:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:1.0:1788744337.640671:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744337.640677:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ea expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.640693:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3600, rc 0) 00000100:00100000:1.0:1788744337.640905:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+25:11470:x1875634047493888:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 598us (865us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1788744337.640913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 162 00000100:00100000:0.0:1788744337.645122:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.645243:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047494016 00000100:00100000:1.0:1788744337.645253:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047494016 00000100:00100000:1.0:1788744337.645351:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 163 00000100:00100000:1.0:1788744337.645362:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+25:11470:x1875634047494016:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:1.0:1788744337.645467:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645485:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645499:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645516:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645523:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645530:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645946:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645956:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.645963:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744337.646162:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646176:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646191:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646197:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646202:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744337.646206:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646213:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646225:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744337.646228:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744337.646233:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646238:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b95175 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646252:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646257:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646263:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646268:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744337.646277:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646283:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646291:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac3570900) 00010000:00010000:1.0:1788744337.646293:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744337.646296:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646302:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b9517c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646317:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646322:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646327:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646332:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744337.646335:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646340:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646347:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744337.646350:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744337.646359:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.646366:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744337.646459:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+25:11470:x1875634047494016:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1097us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.646469:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 163 00000100:00100000:2.0:1788744337.649067:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.649155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047494272 00000100:00100000:1.0:1788744337.649164:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047494272 00000100:00100000:1.0:1788744337.649247:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:1.0:1788744337.649257:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+25:11470:x1875634047494272:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744337.649475:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+26:11470:x1875634047494272:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 219us (419us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788744337.649482:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:3.0:1788744337.709646:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744337.709930:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047494528 00000100:00100000:2.0:1788744337.709945:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047494528 00000100:00100000:2.0:1788744337.710022:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 164 00000100:00100000:2.0:1788744337.710035:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:11473:x1875634047494528:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744337.710073:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744337.710100:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b9518a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613f1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710220:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710238:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710250:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710266:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710272:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.710280:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711095:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9519f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711121:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9519f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711129:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9519f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744337.711144:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788744337.711273:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711281:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711287:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711292:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744337.711297:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711303:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711317:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:2.0:1788744337.711320:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744337.711325:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711331:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711344:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711356:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711362:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711367:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744337.711370:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711377:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711385:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744337.711387:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744337.711390:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711395:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95198 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711457:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b9518a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f1 expref: 29 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711470:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9519f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f1 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744337.711477:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:2.0:1788744337.711479:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744337.711487:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744337.711915:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+28:11473:x1875634047494528:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1880us (2280us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788744337.711925:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 164 00000100:00100000:0.0:1788744337.720519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744337.721001:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.721102:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047494784 00000100:00100000:3.0:1788744337.721115:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047494784 00000100:00100000:3.0:1788744337.721194:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744337.721205:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:2354:x1875634047494784:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744337.721224:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744337.721256:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9519f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f1 expref: 28 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744337.721284:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744337.721291:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744337.721371:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+27:2354:x1875634047494784:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 167us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744337.721379:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:1.0:1788744337.722943:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047494656 00000100:00100000:1.0:1788744337.722956:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047494656 00000100:00100000:1.0:1788744337.723052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 165 00000100:00100000:1.0:1788744337.723062:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+27:11473:x1875634047494656:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:1.0:1788744337.723127:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723144:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723156:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723182:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723200:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723206:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723212:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744337.723216:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723223:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723234:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744337.723237:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744337.723241:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.723247:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744337.723323:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+27:11473:x1875634047494656:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 262us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744337.723330:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 165 00000100:00100000:0.0:1788744337.726276:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744337.726443:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047495040 00000100:00100000:3.0:1788744337.726453:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047495040 00000100:00100000:3.0:1788744337.726524:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:3.0:1788744337.726535:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+27:11473:x1875634047495040:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744337.727038:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:11473:x1875634047495040:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 501us (766us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788744337.727049:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:2.0:1788744337.934047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.934276:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047495296 00000100:00100000:1.0:1788744337.934289:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047495296 00000100:00100000:1.0:1788744337.934357:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 166 00000100:00100000:1.0:1788744337.934369:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+28:11491:x1875634047495296:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:1.0:1788744337.934407:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744337.934462:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613f8 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.934635:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b951bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.934651:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b951bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.934677:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b951bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744337.934691:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788744337.935241:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f8 expref: 31 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.935263:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b951bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f8 expref: 30 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744337.935273:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:1.0:1788744337.935276:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744337.935280:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2600, rc 0) 00000100:00100000:1.0:1788744337.935361:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+30:11491:x1875634047495296:12345-192.168.204.56@tcp:101:cat.0 Request processed in 992us (1324us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788744337.935369:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 166 00000100:00100000:2.0:1788744337.990373:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744337.990484:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047495424 00000100:00100000:0.0:1788744337.990495:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047495424 00000100:00100000:0.0:1788744337.990595:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00100000:0.0:1788744337.990606:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+30:11492:x1875634047495424:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744337.990632:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744337.990653:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b951c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57613ff expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990768:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990783:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990796:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744337.990835:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788744337.990839:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744337.990859:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990887:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b951c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ff expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990907:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ff expref: 31 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744337.990915:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744337.990925:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744337.990929:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77200, rc 0) 00000100:00100000:0.0:1788744337.991265:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+31:11492:x1875634047495424:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 660us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744337.991272:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 167 00000100:00100000:2.0:1788744337.999546:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744337.999986:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047495808 00000100:00100000:1.0:1788744338.000006:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047495808 00000100:00100000:1.0:1788744338.000085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:1.0:1788744338.000103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:11492:x1875634047495808:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744338.001438:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:11492:x1875634047495808:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 1332us (1895us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788744338.001453:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:2.0:1788744338.011194:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744338.012192:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047495936 00000100:00100000:3.0:1788744338.012213:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047495936 00000100:00100000:3.0:1788744338.012313:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:3.0:1788744338.012328:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:11492:x1875634047495936:12345-192.168.204.56@tcp:103:lfs.0 00010000:00010000:3.0:1788744338.012354:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788744338.012385:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b95160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613e3 expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744338.012415:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b951bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613f8 expref: 31 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744338.012431:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95064 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613a4 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744338.012472:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90af300) 00010000:00010000:3.0:1788744338.012491:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744338.013076:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+29:11492:x1875634047495936:12345-192.168.204.56@tcp:103:lfs.0 Request processed in 749us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744338.013084:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:2.0:1788744338.018265:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744338.018362:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496064 00000100:00100000:1.0:1788744338.018374:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496064 00000100:00100000:1.0:1788744338.018443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 168 00000100:00100000:1.0:1788744338.018454:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+29:11492:x1875634047496064:12345-192.168.204.56@tcp:58:lfs.0 00010000:00010000:1.0:1788744338.018858:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744338.018879:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744338.018893:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744338.019317:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788744338.022158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+29:11492:x1875634047496064:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 3685us (3886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744338.022181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 168 00000100:00100000:2.0:1788744338.079510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744338.079737:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496192 00000100:00100000:0.0:1788744338.079758:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496192 00000100:00100000:0.0:1788744338.079848:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 169 00000100:00100000:0.0:1788744338.079862:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+29:11494:x1875634047496192:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744338.079892:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744338.079918:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b951de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761406 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080028:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080047:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080065:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080084:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080092:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080099:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080497:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080507:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080514:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744338.080850:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788744338.080855:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744338.080880:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080894:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080903:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.080910:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081054:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081062:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744338.081067:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081075:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081100:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744338.081104:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744338.081109:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081115:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b951e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081129:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081135:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081141:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081145:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744338.081148:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081153:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081161:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af800) 00010000:00010000:0.0:1788744338.081163:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744338.081165:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081171:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b951ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081222:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b951de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081235:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 30 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744338.081241:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:0.0:1788744338.081243:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744338.081246:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76e00, rc 0) 00000100:00100000:0.0:1788744338.081342:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+30:11494:x1875634047496192:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1482us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744338.081351:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 169 00010000:00010000:0.0:1788744338.141047:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744339.038372:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744339.038386:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744339.038465:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788744339.038473:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744339.038680:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068468352:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744339.038828:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7c3b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744339.063639:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0509c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068468352:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788744339.079098:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744339.079489:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496320 00000100:00100000:2.0:1788744339.079502:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496320 00000100:00100000:2.0:1788744339.079646:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 170 00000100:00100000:2.0:1788744339.079662:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+30:11505:x1875634047496320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744339.079707:0:6704:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744339.079856:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+30:11505:x1875634047496320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 200us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744339.079865:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 170 00000100:00080000:0.0:1788744339.080111:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744339.124093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.130221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496448 00000100:00100000:3.0:1788744339.130251:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496448 00000100:00100000:3.0:1788744339.130428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 171 00000100:00100000:3.0:1788744339.130443:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+30:11505:x1875634047496448:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788744339.130880:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.130908:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.130932:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131651:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131684:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131700:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131760:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131783:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131791:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744339.131860:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788744339.131865:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744339.131884:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131899:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131905:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131913:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131919:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744339.131924:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131933:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.131946:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:3.0:1788744339.131950:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744339.132457:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132479:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f200/0x7cd2bfd5e1b951fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132496:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132502:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132509:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132515:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744339.132519:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132525:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132534:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff940ad8818700) 00010000:00010000:3.0:1788744339.132536:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744339.132539:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132744:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b95201 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132765:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132772:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132784:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132790:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744339.132793:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132799:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132807:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:3.0:1788744339.132810:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744339.132813:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.132820:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.133199:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+30:11505:x1875634047496448:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 Request processed in 2750us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744339.133210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 171 00000100:00100000:2.0:1788744339.153059:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.153196:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496704 00000100:00100000:0.0:1788744339.153211:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496704 00000100:00100000:0.0:1788744339.153289:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 172 00000100:00100000:0.0:1788744339.153304:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+30:11505:x1875634047496704:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.153340:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744339.153369:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b9520f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576140d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.153513:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.153533:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.154164:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744339.154181:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788744339.155000:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155013:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155021:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155030:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.155036:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155045:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155060:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:0.0:1788744339.155063:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744339.155068:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155074:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155183:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b9520f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576140d expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155216:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:0.0:1788744339.155218:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744339.155222:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b9520f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576140d expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.155233:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76c00, rc 0) 00000100:00100000:0.0:1788744339.155373:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047496704:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 2072us (2334us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788744339.155382:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 172 00010000:00010000:2.0:1788744339.163266:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744339.168592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744339.168693:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047496832 00000100:00100000:2.0:1788744339.168703:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047496832 00000100:00100000:2.0:1788744339.168781:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 173 00000100:00100000:2.0:1788744339.168792:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047496832:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744339.168842:0:10823:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744339.168972:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047496832:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 181us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744339.168980:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 173 00000100:00100000:1.0:1788744339.192348:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.193007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497088 00000100:00100000:3.0:1788744339.194273:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497088 00000100:00100000:3.0:1788744339.194479:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 174 00000100:00100000:3.0:1788744339.194498:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047497088:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744339.194619:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744339.194627:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744339.194872:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b951d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57613ff expref: 31 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.194936:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744339.194944:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744339.194971:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95224 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761414 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744339.203419:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788744339.206598:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9522b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.206660:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.206687:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9522b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.206819:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95224 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761414 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.206851:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9522b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761414 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.206862:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ad8818700) 00010000:00010000:3.0:1788744339.206865:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744339.206870:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac164ee00, rc 0) 00000100:00100000:3.0:1788744339.206994:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+32:11505:x1875634047497088:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 12498us (14683us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788744339.207016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 174 00000100:00100000:3.0:1788744339.217034:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.221175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497344 00000100:00100000:0.0:1788744339.221200:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497344 00000100:00100000:0.0:1788744339.221313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 175 00000100:00100000:0.0:1788744339.221328:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:11505:x1875634047497344:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.221402:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744339.221435:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9522b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761414 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221460:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ad8818700) 00010000:00010000:0.0:1788744339.221473:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744339.221505:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221522:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221581:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221598:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221606:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221612:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221872:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221880:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221886:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221893:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.221899:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221908:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221917:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744339.221920:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744339.221925:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221937:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95239 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221949:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221955:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221962:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221967:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.221971:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221977:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221985:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9a7c61de (ffff940ad90af800) 00010000:00010000:0.0:1788744339.221988:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744339.221991:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.221997:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95240 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a7c61de bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.222120:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047497344:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 795us (5104us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744339.222129:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 175 00000100:00100000:0.0:1788744339.230103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744339.230208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497472 00000100:00100000:2.0:1788744339.230224:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497472 00000100:00100000:2.0:1788744339.230318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 176 00000100:00100000:2.0:1788744339.230332:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+31:11505:x1875634047497472:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744339.230367:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744339.230405:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576141b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230466:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230486:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230501:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230759:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b95247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230790:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744339.230800:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:2.0:1788744339.230803:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788744339.230806:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744339.230875:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:11505:x1875634047497472:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 545us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744339.230883:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 176 00000100:00100000:3.0:1788744339.240183:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.241199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497728 00000100:00100000:0.0:1788744339.241221:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497728 00000100:00100000:0.0:1788744339.241336:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 177 00000100:00100000:0.0:1788744339.241354:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+32:11505:x1875634047497728:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.241492:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.241520:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.241538:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744339.242011:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1788744339.242023:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411374472943ns, next at 412374470358ns, rc = 0 00000004:00010000:0.0:1788744339.242123:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008510184f reply state 00000000a3651623 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.242136:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788744339.242270:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+34:11505:x1875634047497728:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 921us (2106us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788744339.242279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 177 00010000:00010000:0.0:1788744339.249405:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249427:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249436:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249468:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.249473:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249482:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249502:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744339.249506:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744339.249511:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.249518:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95255 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.251281:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.251349:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497856 00000100:00100000:0.0:1788744339.251370:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497856 00000100:00100000:0.0:1788744339.251461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 178 00000100:00100000:0.0:1788744339.251475:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+33:11505:x1875634047497856:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.251511:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744339.251536:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761422 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.251648:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.251666:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.251713:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744339.251716:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744339.251720:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76600, rc 0) 00000100:00100000:0.0:1788744339.251798:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+34:11505:x1875634047497856:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 325us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.251805:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 178 00000100:00100000:0.0:1788744339.266963:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.271724:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047497984 00000100:00100000:1.0:1788744339.271740:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047497984 00000100:00100000:1.0:1788744339.271845:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:1.0:1788744339.271860:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047497984:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788744339.272306:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047497984:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 449us (5361us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788744339.272337:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00080000:0.0:1788744339.275518:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744339.290851:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.291244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047498240 00000100:00100000:1.0:1788744339.291265:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047498240 00000100:00100000:1.0:1788744339.291356:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:1.0:1788744339.291369:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+34:11505:x1875634047498240:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744339.291712:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+35:11505:x1875634047498240:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 345us (885us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788744339.291721:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:3.0:1788744339.297464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.297770:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047498496 00000100:00100000:0.0:1788744339.297793:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047498496 00000100:00100000:0.0:1788744339.297886:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:0.0:1788744339.297898:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+35:11505:x1875634047498496:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744339.298037:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+35:11505:x1875634047498496:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 141us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.298049:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:3.0:1788744339.328405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.328749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047498624 00000100:00100000:1.0:1788744339.328767:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047498624 00000100:00100000:1.0:1788744339.328853:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 180 00000100:00100000:1.0:1788744339.328864:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+35:11505:x1875634047498624:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744339.328893:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744339.328919:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95263 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761429 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.328997:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.329011:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.329026:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744339.329083:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744339.329107:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.329153:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95263 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761429 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.329180:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761429 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.329188:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744339.329192:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788744339.329197:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3400, rc 0) 00000100:00100000:1.0:1788744339.329265:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+36:11505:x1875634047498624:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 403us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744339.329273:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 180 00000100:00100000:3.0:1788744339.362955:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.363033:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047498752 00000100:00100000:0.0:1788744339.363049:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047498752 00000100:00100000:0.0:1788744339.363115:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:0.0:1788744339.363126:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047498752:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.363148:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744339.363175:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761430 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744339.363206:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1292, blocks: 0x1 00010000:00010000:0.0:1788744339.363234:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788744339.363260:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744339.363280:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.363303:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.363319:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77e00, rc 0) 00000100:00100000:0.0:1788744339.363405:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047498752:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 280us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.363413:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:3.0:1788744339.386399:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.395824:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499008 00000100:00100000:0.0:1788744339.395846:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499008 00000100:00100000:1.0:1788744339.396923:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 181 00000100:00100000:1.0:1788744339.396940:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+36:11505:x1875634047499008:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744339.397087:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+36:11505:x1875634047499008:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 149us (10700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744339.397095:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 181 00000100:00100000:2.0:1788744339.412210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.412446:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499136 00000100:00100000:1.0:1788744339.412465:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499136 00000100:00100000:1.0:1788744339.412536:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:1.0:1788744339.412575:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:11505:x1875634047499136:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744339.412599:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744339.412622:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761437 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.412684:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.412694:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744339.412699:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744339.412705:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.412748:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.412763:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744339.412779:0:6680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068468480:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744339.412909:0:6680:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620900 going to sleep for 11 seconds 00000100:00100000:1.0:1788744339.425225:0:6680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa485c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875634068468480:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744339.425288:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.425315:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3c00, rc 0) 00000100:00100000:1.0:1788744339.425391:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:11505:x1875634047499136:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 12818us (13195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744339.425401:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:0.0:1788744339.434867:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.450868:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499264 00000100:00100000:3.0:1788744339.450892:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499264 00010000:00010000:3.0:1788744339.450971:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.451034:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 67 00000100:00100000:3.0:1788744339.451047:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:2354:x1875634047499264:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744339.451076:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744339.451117:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.451134:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.451164:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed7d0440/0x7cd2bfd5e1b95271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761430 expref: 9 pid: 6681 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.451187:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744339.451192:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744339.451222:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.451233:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.451279:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.451296:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068468608:192.168.204.56@tcp:105: 00000100:00100000:3.0:1788744339.451398:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788744339.461031:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5822:1875634068468608:192.168.204.56@tcp:105: 00010000:00010000:1.0:1788744339.461062:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744339.461133:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047499264:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 10088us (26272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744339.461144:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 67 00000100:00100000:2.0:1788744339.499578:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.499763:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499392 00000100:00100000:1.0:1788744339.499776:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499392 00002000:00100000:1.0:1788744339.499860:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9409c3766d80 x1875634047499392/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:615/0 lens 504/0 e 0 to 0 dl 1788744350 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744339.499874:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9409c3766d80 with x1875634047499392 ext(0->8) 00002000:00010000:1.0:1788744339.499880:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9409c3766d80 00000100:00100000:1.0:1788744339.499915:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:1.0:1788744339.499927:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047499392:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788744339.500508:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+10:2353:x1875634047499392:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 Request processed in 580us (985us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788744339.500518:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00002000:00100000:1.0:1788744339.500526:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9409c3766d80 x1875634047499392/t4294967315(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:615/0 lens 504/448 e 0 to 0 dl 1788744350 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744339.500573:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9409c3766d80 with x1875634047499392 ext(0->8) 00002000:00010000:1.0:1788744339.500579:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9409c3766d80 00000100:00100000:1.0:1788744339.504482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.504982:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499520 00000100:00100000:3.0:1788744339.504996:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499520 00000100:00100000:3.0:1788744339.505067:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 182 00000100:00100000:3.0:1788744339.505080:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+36:11505:x1875634047499520:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 00000040:00080000:2.0:1788744339.590706:0:12405:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744339.590719:0:12405:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744339.590788:0:12405:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788744339.590798:0:12405:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788744339.617337:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1788744339.617352:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788744339.617376:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788744339.617388:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788744339.617889:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788744339.617903:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788744339.617925:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068468736:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788744339.618004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744339.618082:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068468736 00000100:00100000:2.0:1788744339.618091:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068468736 00000100:00100000:2.0:1788744339.618151:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788744339.618169:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068468736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788744339.618350:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788744339.618354:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744339 00002000:00010000:2.0:1788744339.618357:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788744339.618359:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788744338 -> 1788744339 00002000:00010000:2.0:1788744339.618361:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788744339.618402:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068468736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (397us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788744339.618410:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788744339.618431:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788744339.618465:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9409c3764000/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788744339.618471:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068468736:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788744339.618649:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+18:11505:x1875634047499520:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 Request processed in 113569us (114176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744339.618658:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 182 00000100:00100000:2.0:1788744339.635233:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.635418:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499648 00000100:00100000:1.0:1788744339.635433:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499648 00000100:00100000:1.0:1788744339.635515:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:1.0:1788744339.635528:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03c88f08-96bd-4666-9af8-74d11f561443+10:2354:x1875634047499648:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788744339.743069:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1788744339.743110:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000100:00100000:1.0:1788744339.743245:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047499648:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 Request processed in 107711us (108016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744339.743257:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:0.0:1788744339.746365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744339.746861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047499904 00000100:00100000:1.0:1788744339.746874:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047499904 00000100:00100000:1.0:1788744339.746945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 183 00000100:00100000:1.0:1788744339.746955:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+18:11505:x1875634047499904:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744339.747021:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744339.747052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b9526a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761429 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.747078:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:1.0:1788744339.747086:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744339.747122:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.747141:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.747155:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744339.747454:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c1a1c1ff reply state 0000000084740cd2 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744339.747465:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744339.753862:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+19:11505:x1875634047499904:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 6891us (7493us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788744339.753879:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 183 00000100:00100000:2.0:1788744339.757458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.757524:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500032 00000100:00100000:0.0:1788744339.758013:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500032 00000100:00100000:0.0:1788744339.758179:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:0.0:1788744339.758192:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047500032:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788744339.758488:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788744339.758492:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788744339 -> 1788744337 00002000:00010000:0.0:1788744339.758495:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788744335 00002000:00010000:0.0:1788744339.758497:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788744339 -> 1788744337 00002000:00010000:0.0:1788744339.758499:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788744339.758615:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2352:x1875634047500032:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 425us (1166us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788744339.758623:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 57 00010000:00010000:3.0:1788744339.759443:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759457:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759479:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759486:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744339.759491:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759501:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759521:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744339.759525:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744339.759544:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.759579:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b9527f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744339.762858:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.763188:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500288 00000100:00100000:0.0:1788744339.763199:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500288 00000100:00100000:0.0:1788744339.763300:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 184 00000100:00100000:0.0:1788744339.763313:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+18:11505:x1875634047500288:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788744339.763420:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.763442:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.763451:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.763493:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.763508:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 18 pid: 5837 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.763525:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068468864:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744339.763695:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744339.772366:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068468864:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744339.772408:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744339.774286:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.774434:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500416 00000100:00100000:3.0:1788744339.774451:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500416 00010000:00010000:3.0:1788744339.774513:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 19 pid: 5837 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.774599:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 68 00000100:00100000:3.0:1788744339.774610:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+19:2354:x1875634047500416:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744339.774636:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744339.774644:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 19 pid: 5837 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.774989:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 19 pid: 5837 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.775020:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9524e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576141b expref: 19 pid: 5837 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.775037:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:3.0:1788744339.775044:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.775055:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.775064:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.776949:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744339.777053:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+18:2354:x1875634047500416:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 2438us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744339.777067:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 68 00010000:00010000:0.0:1788744339.782934:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.782953:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.782995:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783004:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783013:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783021:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.783027:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783036:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783056:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744339.783059:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788744339.783064:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.783070:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95286 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.783974:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+17:11505:x1875634047500288:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 Request processed in 20655us (21120us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788744339.783988:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 184 00000100:00100000:3.0:1788744339.797855:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.797903:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500544 00000100:00100000:3.0:1788744339.797915:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500544 00000100:00100000:3.0:1788744339.797977:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:3.0:1788744339.797988:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047500544:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788744339.798049:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.798106:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.798119:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744339.798124:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744339.798129:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.798171:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.798189:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 8 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.798206:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068468992:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744339.798313:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744339.803139:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068468992:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744339.803183:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.810659:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744339.813187:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500672 00000100:00100000:0.0:1788744339.813215:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500672 00010000:00010000:0.0:1788744339.813286:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.813341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:0.0:1788744339.813353:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047500672:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744339.813371:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744339.813400:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.813416:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.813446:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761437 expref: 9 pid: 6680 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.813467:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744339.813472:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744339.813478:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.813488:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.813885:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744339.813977:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047500672:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 624us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.813987:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 69 00010000:00010000:0.0:1788744339.814081:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814092:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814119:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814128:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814137:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814144:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744339.814148:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814157:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814184:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.814192:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063ca4d6b/0x7cd2bfd5e1b9528d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.814239:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047500544:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 Request processed in 16252us (16398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.814247:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:3.0:1788744339.824854:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.824897:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047500928 00000100:00100000:3.0:1788744339.824909:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047500928 00000100:00100000:3.0:1788744339.824970:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 185 00000100:00100000:3.0:1788744339.824981:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+17:11505:x1875634047500928:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788744339.825074:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825114:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825135:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825399:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825410:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825418:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825452:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.825473:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 18 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.825491:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068469120:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744339.825621:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f6180 going to sleep for 11 seconds 00000100:00100000:3.0:1788744339.834766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.834901:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068469120:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744339.834937:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.837616:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047501056 00000100:00100000:0.0:1788744339.837633:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047501056 00010000:00010000:0.0:1788744339.838094:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 19 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.838144:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:0.0:1788744339.838155:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:2353:x1875634047501056:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744339.838173:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744339.838181:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 19 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838195:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 19 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838217:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b9525c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761422 expref: 19 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838250:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744339.838257:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838265:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838273:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838301:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744339.838367:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+18:2353:x1875634047501056:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 213us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744339.838375:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 70 00010000:00010000:0.0:1788744339.838403:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.838410:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744339.838654:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788744339.840100:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788744339.840159:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788744339.840275:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068469248:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788744339.840355:0:10823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744339.840400:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac62ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744339.841008:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068469248 00000100:00100000:3.0:1788744339.841019:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068469248 00000100:00100000:3.0:1788744339.849422:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788744339.849442:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068469248:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788744339.849636:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068469248:12345-0@lo:1000:mdt00_004.0 Request processed in 201us (9281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744339.849645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744339.851523:0:10823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788744339.851545:0:10823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9409c3764000, transno 4294967316 00000100:00100000:0.0:1788744339.851586:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068469248:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788744339.852287:0:10823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788744339.852397:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068469376:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788744339.852472:0:10823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744339.853162:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744339.854790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068469376 00000100:00100000:2.0:1788744339.854801:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068469376 00000100:00100000:2.0:1788744339.854868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744339.854881:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10823:x1875634068469376:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788744339.855185:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10823:x1875634068469376:12345-0@lo:1000:mdt00_004.0 Request processed in 306us (2710us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788744339.855193:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744339.861866:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10823:1875634068469376:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788744339.861929:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.861942:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.861952:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.861959:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164ee00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.861965:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.861975:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862001:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ac2bbce00) 00010000:00010000:0.0:1788744339.862005:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744339.862012:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862019:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164ee00/0x7cd2bfd5e1b9529b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862065:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862091:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862098:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862104:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744339.862107:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862113:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862123:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:0.0:1788744339.862126:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744339.862130:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862135:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b951d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862163:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862181:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862191:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862240:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.862265:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 21 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744339.862281:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068469504:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744339.862414:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0daad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744339.866926:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068469504:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744339.866963:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.869754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.869809:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047501184 00000100:00100000:3.0:1788744339.869822:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047501184 00010000:00010000:3.0:1788744339.869871:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 22 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.869967:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:3.0:1788744339.869980:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+22:2353:x1875634047501184:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744339.869999:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744339.870007:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 22 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870020:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 22 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870048:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b951f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761406 expref: 22 pid: 5836 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870063:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:3.0:1788744339.870083:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870093:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870101:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.870134:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744339.870146:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870158:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870174:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870181:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870188:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870194:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744339.870198:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870207:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870219:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:1.0:1788744339.870223:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744339.870227:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870234:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b952a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870246:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870253:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870267:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870272:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164f000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744339.870275:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870281:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870290:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570900) 00010000:00010000:1.0:1788744339.870293:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744339.870296:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744339.870302:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac164f000/0x7cd2bfd5e1b95294 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744339.870513:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+21:2353:x1875634047501184:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 534us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744339.870537:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:1.0:1788744339.870580:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+21:11505:x1875634047500928:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 45598us (45731us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788744339.870591:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 185 00000020:00080000:1.0:1788744339.870596:0:10823:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788744339.870746:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788744339.870752:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788744339.871972:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788744339.871985:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744339.872806:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744339.873200:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047501440 00000100:00100000:3.0:1788744339.873212:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047501440 00000100:00100000:3.0:1788744339.873338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:3.0:1788744339.873351:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8694c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+20:11505:x1875634047501440:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788744339.874901:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788744339.875115:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788744339.875173:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875194:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875207:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875218:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875238:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875244:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744339.875354:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788744339.875505:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8694c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:11505:x1875634047501440:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 2153us (2699us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788744339.875516:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00000020:00080000:3.0:1788744339.875522:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788744339.875787:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744339.875795:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.875803:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744339.875807:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.875817:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.875834:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff940ad8818f00) 00010000:00010000:0.0:1788744339.875837:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744339.875844:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.875849:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b952a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744339.875884:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744339.875886:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744339.875889:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788744340.097116:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1788744340.097141:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1788744340.188265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744340.507480:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068469632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744340.507610:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744340.508129:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068470016:0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508175:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744340.508210:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068470144:0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508227:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068469760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744340.508279:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744340.508340:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068469760 00000100:00100000:3.0:1788744340.508347:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068469760 00000100:00100000:3.0:1788744340.508389:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788744340.508398:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068469760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508402:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068470272:0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508433:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744340.508459:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068469760:12345-0@lo:400:kworker.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744340.508467:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788744340.508475:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068469760:0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508496:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788744340.508505:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068469888:0@lo:400:kworker.0 00000100:00100000:3.0:1788744340.508532:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068470144 00000100:00100000:3.0:1788744340.508537:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068470144 00000100:00100000:0.0:1788744340.508544:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744340.508598:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068470016 00000100:00100000:0.0:1788744340.508598:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068470400:0@lo:400:kworker.0 00000100:00100000:3.0:1788744340.508599:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788744340.508607:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068470016 00000100:00100000:3.0:1788744340.508612:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068470144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744340.508630:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744340.508660:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068470272 00000100:00100000:2.0:1788744340.508665:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068470272 00000100:00100000:2.0:1788744340.508687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068469888 00000100:00100000:2.0:1788744340.508690:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068469888 00000100:00100000:2.0:1788744340.508710:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788744340.508718:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068470016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744340.511457:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068469632 00000100:00100000:1.0:1788744340.511476:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068469632 00000100:00100000:1.0:1788744340.511583:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788744340.511595:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068469632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744340.511673:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744340.511815:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068470144:12345-0@lo:400:kworker.0 Request processed in 3203us (3535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744340.511826:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788744340.511849:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068470400 00000100:00100000:3.0:1788744340.511853:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068470400 00000100:00100000:2.0:1788744340.511859:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068470016:12345-0@lo:400:kworker.0 Request processed in 3137us (3679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744340.511871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788744340.511881:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788744340.511891:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068470400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744340.511898:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788744340.511911:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068470272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744340.511930:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068470400:12345-0@lo:400:kworker.0 Request processed in 40us (3299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744340.511938:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744340.511959:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068470272:12345-0@lo:400:kworker.0 Request processed in 52us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744340.511968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788744340.512017:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068469632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 426us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744340.512022:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000100:00100000:1.0:1788744340.512026:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000004:00080000:0.0:1788744340.512031:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1788744340.512058:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940af6e2ce00, transno 4294967307 00000100:00100000:0.0:1788744340.512082:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068470400:0@lo:400:kworker.0 00000100:00100000:1.0:1788744340.512118:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad8179f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068470272:0@lo:400:kworker.0 00000100:00080000:1.0:1788744340.512160:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744340.512166:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744340.512187:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068470016:0@lo:400:kworker.0 00000100:00100000:1.0:1788744340.512227:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad817b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068470144:0@lo:400:kworker.0 00000100:00100000:1.0:1788744340.512246:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa484a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068469632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744340.512485:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068469888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744340.512571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788744340.512577:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068469888:12345-0@lo:400:kworker.0 Request processed in 95us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744340.512586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788744340.512878:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068469888:0@lo:400:kworker.0 00010000:00010000:0.0:1788744341.211217:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744341.540206:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068470528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744341.540300:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744341.540395:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068470528 00000100:00100000:3.0:1788744341.540404:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068470528 00000100:00100000:3.0:1788744341.540465:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788744341.540478:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068470528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744341.540529:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744341.540626:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875634068470528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744341.540634:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788744341.540672:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744341.540736:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068470528:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788744341.741636:0:12460:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744341.742236:0:12460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744341.742303:0:12460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788744341.742311:0:12460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744341.909431:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744341.910609:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047501696 00000100:00100000:1.0:1788744341.910628:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047501696 00000100:00100000:1.0:1788744341.910748:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 186 00000100:00100000:1.0:1788744341.910763:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+22:11523:x1875634047501696:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744341.910799:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744341.910822:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576143e expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.911042:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b952b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.911059:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b952b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.911072:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b952b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744341.911093:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788744341.911295:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576143e expref: 25 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.911317:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b952b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576143e expref: 24 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.911325:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744341.911328:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00080000:3.0:1788744341.911380:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788744341.911414:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3a00, rc 0) 00000100:00100000:1.0:1788744341.911504:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+24:11523:x1875634047501696:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 745us (2081us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788744341.911511:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 186 00000100:00100000:2.0:1788744341.927373:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744341.927613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047501824 00000100:00100000:1.0:1788744341.927626:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047501824 00000100:00100000:1.0:1788744341.927692:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 187 00000100:00100000:1.0:1788744341.927702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:11523:x1875634047501824:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:1.0:1788744341.927810:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.927830:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.927844:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.927862:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.927878:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.927885:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928114:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928122:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928130:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744341.928172:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928185:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928192:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928198:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928203:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744341.928207:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928213:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928233:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744341.928236:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744341.928241:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928248:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b952c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928262:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928268:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928274:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928279:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744341.928281:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928286:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928294:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac3570900) 00010000:00010000:1.0:1788744341.928296:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744341.928299:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928304:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b952cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928327:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928333:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928338:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928343:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744341.928346:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928353:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928360:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac3570400) 00010000:00010000:1.0:1788744341.928362:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744341.928365:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744341.928369:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b952d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744341.928453:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+24:11523:x1875634047501824:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 751us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744341.928461:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 187 00000100:00100000:3.0:1788744341.991635:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744341.991875:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502080 00000100:00100000:0.0:1788744341.991904:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502080 00000100:00100000:0.0:1788744341.991969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 188 00000100:00100000:0.0:1788744341.991979:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+24:11526:x1875634047502080:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744341.992003:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744341.992026:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b952da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761445 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992116:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992132:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992144:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992157:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992163:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.992168:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.994475:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.994508:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.994522:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744341.994543:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788744341.995291:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.995301:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.995308:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.995313:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744341.995317:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.995325:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.995338:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744341.996903:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744341.996915:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996927:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b952e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996943:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996951:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996979:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996985:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744341.996988:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.996996:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.997011:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90af800) 00010000:00010000:0.0:1788744341.997013:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744341.997016:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.997022:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b952e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744341.997087:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77a00/0x7cd2bfd5e1b952da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.000856:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.000873:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:0.0:1788744342.000876:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744342.000880:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77600, rc 0) 00000100:00100000:0.0:1788744342.000960:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+26:11526:x1875634047502080:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 8981us (9340us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788744342.000980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 188 00000100:00100000:0.0:1788744342.001069:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.001194:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.001221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.001246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.001273:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502336 00000100:00100000:0.0:1788744342.001281:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502336 00000100:00100000:0.0:1788744342.001335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502464 00000100:00100000:0.0:1788744342.001339:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502464 00000100:00100000:0.0:1788744342.001362:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:0.0:1788744342.001371:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047502336:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744342.001415:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047502336:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.001421:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:0.0:1788744342.001435:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:0.0:1788744342.001441:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047502464:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744342.001465:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2353:x1875634047502464:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.001471:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:0.0:1788744342.001500:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502208 00000100:00100000:0.0:1788744342.001505:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502208 00000100:00100000:0.0:1788744342.001531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 306 00000100:00100000:0.0:1788744342.001538:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047502208:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744342.001580:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2353:x1875634047502208:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.001597:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 306 00000100:00080000:0.0:1788744342.001628:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744342.001632:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744342.003996:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502592 00000100:00100000:0.0:1788744342.004013:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502592 00000100:00100000:0.0:1788744342.004143:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 175 00000100:00100000:0.0:1788744342.004154:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047502592:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744342.004245:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2353:x1875634047502592:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 92us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.004252:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 175 00000100:00100000:1.0:1788744342.018055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00080000:2.0:1788744342.021404:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744342.021436:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502720 00000100:00100000:2.0:1788744342.021447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502720 00000100:00100000:2.0:1788744342.021540:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 189 00000100:00100000:2.0:1788744342.021587:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+26:11526:x1875634047502720:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:2.0:1788744342.021661:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021697:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021727:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021734:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021740:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021746:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744342.021750:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021756:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021767:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744342.021770:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744342.021774:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.021780:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b952fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.021853:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+26:11526:x1875634047502720:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 304us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.021860:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 189 00000100:00100000:0.0:1788744342.038482:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744342.038924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047502976 00000100:00100000:1.0:1788744342.038935:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047502976 00000100:00100000:1.0:1788744342.039014:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:1.0:1788744342.039024:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+26:11526:x1875634047502976:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744342.039588:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+27:11526:x1875634047502976:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 563us (1114us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788744342.039597:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:2.0:1788744342.098044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.098213:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047503232 00000100:00100000:0.0:1788744342.098225:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047503232 00000100:00100000:0.0:1788744342.098305:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 190 00000100:00100000:0.0:1788744342.098318:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+27:11052:x1875634047503232:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744342.098360:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744342.098383:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95304 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576144c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.098527:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.098594:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.098605:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.099092:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.099109:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 28 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.099126:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceea9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068470656:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744342.099250:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744342.106089:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceea9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068470656:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744342.106406:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.107674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.107952:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047503360 00000100:00100000:0.0:1788744342.107963:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047503360 00010000:00010000:0.0:1788744342.108010:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 29 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.108049:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:0.0:1788744342.108060:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+29:2354:x1875634047503360:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744342.108080:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744342.108088:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 29 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108115:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 29 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108142:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b952ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761445 expref: 29 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108160:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:0.0:1788744342.108183:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108194:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108201:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.108245:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744342.108311:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:2354:x1875634047503360:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 252us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.108318:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 72 00010000:00010000:1.0:1788744342.108591:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.108600:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744342.108624:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788744342.108817:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95304 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.108835:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.108842:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:1.0:1788744342.108845:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744342.108848:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76400, rc 0) 00000100:00100000:1.0:1788744342.108880:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:11052:x1875634047503232:12345-192.168.204.56@tcp:101:bash.0 Request processed in 10565us (10848us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788744342.108887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 190 00000100:00100000:0.0:1788744342.114830:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744342.114948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047503616 00000100:00100000:1.0:1788744342.114959:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047503616 00000100:00100000:1.0:1788744342.115020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 191 00000100:00100000:1.0:1788744342.115031:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:11052:x1875634047503616:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:1.0:1788744342.115333:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.115464:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.115478:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744342.115572:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788744342.115602:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a1a1c58a reply state 000000007e753298 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744342.115610:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788744342.115734:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788744342.115940:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+32:11052:x1875634047503616:12345-192.168.204.56@tcp:36:bash.0 Request processed in 908us (1117us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788744342.115948:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 191 00000020:00080000:1.0:1788744342.115954:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788744342.117789:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117817:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117825:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117831:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.117837:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117844:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117860:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:0.0:1788744342.117863:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744342.117884:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.117890:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b95319 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.120609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.120710:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047503744 00000100:00100000:2.0:1788744342.120722:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047503744 00000100:00100000:2.0:1788744342.120785:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 192 00000100:00100000:2.0:1788744342.120797:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+31:11052:x1875634047503744:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744342.120836:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744342.120858:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95320 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761453 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.120921:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761453 expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.120937:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95320 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761453 expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.120957:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744342.120960:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744342.120964:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744342.121023:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+32:11052:x1875634047503744:12345-192.168.204.56@tcp:101:bash.0 Request processed in 227us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.121029:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 192 00000100:00100000:2.0:1788744342.125514:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.125781:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047503872 00000100:00100000:0.0:1788744342.125793:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047503872 00000100:00100000:0.0:1788744342.125866:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:0.0:1788744342.125878:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:11052:x1875634047503872:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744342.125901:0:8624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744342.125927:0:8624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576145a expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744342.125958:0:8624:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e1291, atime: 0x6a9e128f, ctime: 0x6a9e1291, blocks: 0xb 00010000:00010000:0.0:1788744342.125990:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1788744342.125995:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744342.126004:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.126024:0:8624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 8 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.126039:0:8624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77600, rc 0) 00000100:00100000:0.0:1788744342.126113:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8178a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+8:11052:x1875634047503872:12345-192.168.204.56@tcp:101:bash.0 Request processed in 237us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.126121:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:0.0:1788744342.129231:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.129700:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504000 00000100:00100000:2.0:1788744342.129713:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504000 00002000:00010000:2.0:1788744342.129764:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788744342.129770:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940af6e2ea00 with x1875634047504000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788744342.129785:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940af6e2ea00. 00000100:00100000:2.0:1788744342.129944:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:2.0:1788744342.129967:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047504000:12345-192.168.204.56@tcp:10:bash.0 00002000:00010000:2.0:1788744342.130242:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788744342.130246:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788744337 -> 1788744341 00002000:00010000:2.0:1788744342.130249:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788744335 -> 1788744335 00002000:00010000:2.0:1788744342.130252:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788744337 -> 1788744341 00002000:00010000:2.0:1788744342.130254:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788744342.130525:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2354:x1875634047504000:12345-192.168.204.56@tcp:10:bash.0 Request processed in 558us (1302us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788744342.130534:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00002000:00010000:2.0:1788744342.130538:0:6685:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788744342.130541:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940af6e2ea00 with x1875634047504000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788744342.130589:0:6685:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940af6e2ea00. 00010000:00010000:1.0:1788744342.235053:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744342.235971:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.236054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504128 00000100:00100000:3.0:1788744342.236066:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504128 00000100:00100000:3.0:1788744342.236128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 193 00000100:00100000:3.0:1788744342.236141:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:11541:x1875634047504128:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:3.0:1788744342.236222:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236241:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236255:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236271:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236278:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236283:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236945:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236966:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.236974:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744342.237021:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237034:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237042:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237051:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237058:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.237061:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237070:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237082:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744342.237085:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.237089:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237094:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9532e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237115:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237122:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237127:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237133:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.237136:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237142:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237150:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad8818b00) 00010000:00010000:3.0:1788744342.237152:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.237156:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237161:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237179:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237185:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237191:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237202:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.237205:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237210:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237218:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:3.0:1788744342.237220:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.237223:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.237228:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9533c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744342.237369:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+32:11541:x1875634047504128:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 1228us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744342.237379:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 193 00000100:00100000:2.0:1788744342.297302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.297435:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504384 00000100:00100000:0.0:1788744342.297447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504384 00000100:00100000:0.0:1788744342.297534:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 194 00000100:00100000:0.0:1788744342.297586:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+32:11544:x1875634047504384:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744342.297617:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744342.297655:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761461 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297741:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297766:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297778:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297795:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297916:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.297924:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298229:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298240:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744342.298267:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788744342.298376:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298384:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298391:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298398:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.298403:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298410:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298424:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744342.298428:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744342.298432:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298438:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77200/0x7cd2bfd5e1b9534a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298451:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298457:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298469:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298473:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.298476:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298493:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298501:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90afe00) 00010000:00010000:0.0:1788744342.298504:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744342.298506:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298512:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298614:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761461 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298628:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761461 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.298635:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:0.0:1788744342.298637:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744342.298639:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76800, rc 0) 00000100:00100000:0.0:1788744342.299007:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+34:11544:x1875634047504384:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1462us (1716us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788744342.299025:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 194 00000100:00100000:0.0:1788744342.304172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744342.304274:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504512 00000100:00100000:1.0:1788744342.304287:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504512 00000100:00100000:1.0:1788744342.304356:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 195 00000100:00100000:1.0:1788744342.304368:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+34:11544:x1875634047504512:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:1.0:1788744342.304456:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.304475:0:10823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.304513:0:10823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.305327:0:10823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.305351:0:10823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 34 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744342.305371:0:10823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068470784:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744342.305512:0:10823:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744342.308618:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.308864:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504768 00000100:00100000:3.0:1788744342.308874:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504768 00000100:00100000:3.0:1788744342.308942:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:3.0:1788744342.308954:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:5592:x1875634047504768:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788744342.309321:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+36:5592:x1875634047504768:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 368us (714us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788744342.309329:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:1.0:1788744342.310407:0:10823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10823:1875634068470784:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744342.310445:0:10823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.313064:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.313168:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047504896 00000100:00100000:3.0:1788744342.313177:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047504896 00010000:00010000:3.0:1788744342.313218:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 36 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744342.313313:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 73 00000100:00100000:3.0:1788744342.313323:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+36:2353:x1875634047504896:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744342.313340:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744342.313347:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 36 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313360:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 36 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313383:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76400/0x7cd2bfd5e1b9530b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576144c expref: 36 pid: 5837 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313400:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:3.0:1788744342.313406:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313417:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313425:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.313460:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744342.313533:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+35:2353:x1875634047504896:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 211us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744342.313540:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 73 00010000:00010000:1.0:1788744342.313649:0:10823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313657:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313689:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313695:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313702:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313724:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744342.313729:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313739:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313756:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:1.0:1788744342.313759:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744342.313763:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.313768:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b95366 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744342.314110:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+34:11544:x1875634047504512:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 9743us (9949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744342.314118:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 195 00000100:00100000:1.0:1788744342.317608:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.318780:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047505152 00000100:00100000:3.0:1788744342.318820:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047505152 00000100:00100000:3.0:1788744342.318886:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:3.0:1788744342.318897:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+34:11544:x1875634047505152:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744342.319158:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:11544:x1875634047505152:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 262us (1563us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788744342.319166:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:2.0:1788744342.443812:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.443949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047505408 00000100:00100000:3.0:1788744342.443960:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047505408 00000100:00100000:3.0:1788744342.444029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 196 00000100:00100000:3.0:1788744342.444040:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+35:11555:x1875634047505408:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:3.0:1788744342.444065:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744342.444086:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9536d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761468 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444172:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444186:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444197:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444210:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444217:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444224:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444705:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444721:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.444729:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744342.444740:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788744342.445468:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445477:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445494:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445500:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.445505:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445513:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445526:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744342.445529:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.445535:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445582:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031a00/0x7cd2bfd5e1b95374 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445598:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445604:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445610:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445615:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.445619:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445625:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445644:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad8818b00) 00010000:00010000:3.0:1788744342.445647:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.445650:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445656:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030e00/0x7cd2bfd5e1b9537b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445706:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0031e00/0x7cd2bfd5e1b9536d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761468 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445960:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761468 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.445975:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:3.0:1788744342.445977:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744342.445980:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744342.446129:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8179f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+37:11555:x1875634047505408:12345-192.168.204.56@tcp:101:cat.0 Request processed in 2090us (2337us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788744342.446138:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 196 00000100:00100000:0.0:1788744342.455594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.455765:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047505664 00000100:00100000:3.0:1788744342.455775:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047505664 00000100:00100000:3.0:1788744342.455841:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:3.0:1788744342.455852:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+37:11555:x1875634047505664:12345-192.168.204.56@tcp:35:cat.0 00000100:00100000:3.0:1788744342.456501:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+38:11555:x1875634047505664:12345-192.168.204.56@tcp:35:cat.0 Request processed in 649us (964us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788744342.456510:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 54 00000100:00100000:1.0:1788744342.523845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.524831:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047505920 00000100:00100000:2.0:1788744342.524849:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047505920 00000100:00100000:2.0:1788744342.524923:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 197 00000100:00100000:2.0:1788744342.524932:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+38:11556:x1875634047505920:12345-192.168.204.56@tcp:36:rm.0 00010000:00010000:2.0:1788744342.524990:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788744342.525024:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761468 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525047:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761461 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525084:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95320 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761453 expref: 36 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525108:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744342.525123:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744342.525152:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525167:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525178:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525194:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525201:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525207:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525752:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525764:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.525771:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744342.527595:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788744342.527608:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414660058290ns, next at 415660055335ns, rc = 0 00010000:00010000:2.0:1788744342.527683:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527698:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527708:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527716:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527723:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527729:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527745:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744342.527767:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527773:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527779:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.527784:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.528472:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744342.528494:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.528502:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744342.528506:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.530189:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.530740:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:0.0:1788744342.530744:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744342.530752:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.530760:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b953a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.530785:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744342.530787:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744342.530790:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744342.531015:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531025:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531034:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744342.531037:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788744342.531040:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531046:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9539e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531076:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531082:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531088:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531094:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744342.531097:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531103:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531111:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:2.0:1788744342.531114:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744342.531135:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.531141:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95390 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744342.531152:0:6704:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008f741f39 reply state 00000000122a1cbf transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.531161:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744342.531276:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+37:11556:x1875634047505920:12345-192.168.204.56@tcp:36:rm.0 Request processed in 6339us (7436us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788744342.531286:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 197 00010000:00010000:3.0:1788744342.547278:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547299:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547308:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547314:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744342.547319:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547328:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547361:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac2bbc600) 00010000:00010000:3.0:1788744342.547364:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744342.547370:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.547376:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744342.604586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.604727:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506176 00000100:00100000:0.0:1788744342.604738:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506176 00000100:00100000:0.0:1788744342.604814:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 198 00000100:00100000:0.0:1788744342.604824:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+36:11562:x1875634047506176:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744342.604869:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744342.604893:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b953ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576146f expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605024:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605040:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605051:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605066:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605072:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.605078:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788744342.605994:0:10823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788744342.606175:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606187:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606196:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606258:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606266:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606274:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606280:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.606284:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606292:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606304:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:0.0:1788744342.606307:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744342.606311:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.606316:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b953b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744342.606976:0:10823:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003203a327 reply state 000000000640532a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.606993:0:10823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788744342.607043:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b953ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 39 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.607077:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 38 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.607085:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:0.0:1788744342.607088:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744342.607091:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77800, rc 0) 00000100:00100000:0.0:1788744342.607183:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+39:11562:x1875634047506176:12345-192.168.204.56@tcp:101:bash.0 Request processed in 2360us (2644us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788744342.607192:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 198 00010000:00010000:0.0:1788744342.613524:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613581:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613591:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613597:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744342.613603:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613611:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613646:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad90afe00) 00010000:00010000:0.0:1788744342.613650:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744342.613656:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.613674:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77000/0x7cd2bfd5e1b953ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744342.620143:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744342.620364:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506304 00000100:00100000:0.0:1788744342.620375:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506304 00000100:00100000:0.0:1788744342.620439:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:0.0:1788744342.620450:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047506304:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744342.620470:0:11969:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744342.620500:0:11969:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761476 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744342.620529:0:11969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744342.620571:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1788744342.620577:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744342.620587:0:11969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 6 pid: 11969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.620608:0:11969:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 6 pid: 11969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.620635:0:11969:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77c00, rc 0) 00000100:00100000:0.0:1788744342.620697:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03c88f08-96bd-4666-9af8-74d11f561443+6:2354:x1875634047506304:12345-192.168.204.56@tcp:101:bash.0 Request processed in 248us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.620704:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:2.0:1788744342.626270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744342.626530:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506432 00000100:00100000:1.0:1788744342.626543:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506432 00000100:00100000:1.0:1788744342.626948:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:1.0:1788744342.626961:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad817ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+6:11562:x1875634047506432:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:1.0:1788744342.626984:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744342.627001:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576147d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.627059:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.627068:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744342.627073:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744342.627078:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.627116:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.627131:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744342.627149:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068470912:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744342.627292:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744342.630406:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aceead880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1875634068470912:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744342.630452:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744342.630485:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3600, rc 0) 00000100:00100000:1.0:1788744342.630603:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad817ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:11562:x1875634047506432:12345-192.168.204.56@tcp:101:bash.0 Request processed in 3643us (4342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744342.630613:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:3.0:1788744342.632861:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.632976:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506560 00000100:00100000:2.0:1788744342.632988:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506560 00010000:00010000:2.0:1788744342.633030:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.633076:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:2.0:1788744342.633086:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+7:2353:x1875634047506560:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744342.633102:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744342.633128:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.633141:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.633167:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82f6a40/0x7cd2bfd5e1b953cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761476 expref: 7 pid: 11969 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.633199:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744342.633203:0:5821:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744342.633212:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.633222:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.633294:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.633310:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068471040:192.168.204.56@tcp:105: 00000100:00100000:2.0:1788744342.633400:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744342.636050:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b33480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5821:1875634068471040:192.168.204.56@tcp:105: 00010000:00010000:3.0:1788744342.636081:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744342.636143:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+6:2353:x1875634047506560:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 3057us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744342.636155:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:3.0:1788744342.638071:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744342.639897:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506816 00000100:00100000:1.0:1788744342.639911:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506816 00000100:00100000:1.0:1788744342.639967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:1.0:1788744342.639978:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+38:11562:x1875634047506816:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:1.0:1788744342.640537:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+39:11562:x1875634047506816:12345-192.168.204.56@tcp:35:bash.0 Request processed in 558us (2474us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788744342.640544:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 55 00000100:00100000:2.0:1788744342.908047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.908193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047506944 00000100:00100000:3.0:1788744342.908205:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047506944 00000100:00100000:3.0:1788744342.908275:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 199 00000100:00100000:3.0:1788744342.908286:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+39:11578:x1875634047506944:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744342.908311:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744342.908339:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b953dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761484 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908413:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908446:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908460:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744342.908519:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788744342.908527:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744342.908544:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908605:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b953dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761484 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908636:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761484 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.908645:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744342.908648:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744342.908652:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc800, rc 0) 00000100:00100000:3.0:1788744342.908727:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+40:11578:x1875634047506944:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 443us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744342.908735:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 199 00000100:00100000:2.0:1788744342.919997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.926126:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507200 00000100:00100000:3.0:1788744342.926144:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507200 00000100:00100000:3.0:1788744342.926364:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 200 00000100:00100000:3.0:1788744342.926379:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+40:11578:x1875634047507200:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744342.926406:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744342.926448:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b953eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576148b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.926619:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b953f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.926638:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b953f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.926957:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b953f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744342.926972:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788744342.927130:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b953eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576148b expref: 43 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.927153:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b953f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576148b expref: 42 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.927161:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:3.0:1788744342.927164:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744342.927168:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fde00, rc 0) 00000100:00100000:3.0:1788744342.927374:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+42:11578:x1875634047507200:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 998us (7387us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788744342.927383:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 200 00000100:00100000:1.0:1788744342.938891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.939705:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507456 00000100:00100000:2.0:1788744342.939718:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507456 00000100:00100000:2.0:1788744342.939790:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 201 00000100:00100000:2.0:1788744342.939801:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+42:11578:x1875634047507456:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744342.939828:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744342.939853:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761492 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.939971:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.940004:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.940018:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744342.940035:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:3.0:1788744342.940155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:2.0:1788744342.940186:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761492 expref: 45 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.940206:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761492 expref: 44 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.940214:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744342.940216:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788744342.940220:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744342.940285:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aceead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+44:11578:x1875634047507456:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 486us (1406us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788744342.940293:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 201 00000100:00100000:2.0:1788744342.940330:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507584 00000100:00100000:2.0:1788744342.940334:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507584 00000100:00100000:2.0:1788744342.940367:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:2.0:1788744342.940374:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+44:2353:x1875634047507584:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744342.940389:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744342.940404:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b953f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576148b expref: 44 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.940427:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744342.940430:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744342.940450:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+43:2353:x1875634047507584:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744342.940456:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:3.0:1788744342.944882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.946867:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507712 00000100:00100000:2.0:1788744342.946882:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507712 00000100:00100000:2.0:1788744342.946957:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:2.0:1788744342.946969:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+6:2351:x1875634047507712:12345-192.168.204.56@tcp:1:lfs.0 00010000:00010000:2.0:1788744342.947014:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.947035:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.947043:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788744342.947153:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788744342.947159:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.947203:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744342.947217:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 6 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744342.947251:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875634068471168:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744342.947352:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744342.955838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744342.955915:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b32d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1875634068471168:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744342.955947:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.956029:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507840 00000100:00100000:0.0:1788744342.956037:0:6686:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507840 00002000:00100000:0.0:1788744342.956107:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff940afa5ded80 x1875634047507840/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:618/0 lens 504/0 e 0 to 0 dl 1788744353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744342.956117:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa5ded80 with x1875634047507840 ext(0->8) 00010000:00010000:0.0:1788744342.956124:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 7 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.956138:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 7 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744342.956145:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940afa5ded80 00000100:00100000:0.0:1788744342.956181:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:0.0:1788744342.956191:0:6686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047507840:12345-192.168.204.56@tcp:4:lfs.0 00000100:00100000:0.0:1788744342.956821:0:6686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03c88f08-96bd-4666-9af8-74d11f561443+9:2354:x1875634047507840:12345-192.168.204.56@tcp:4:lfs.0 Request processed in 628us (993us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788744342.956829:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00002000:00100000:0.0:1788744342.956837:0:6686:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff940afa5ded80 x1875634047507840/t4294967308(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:618/0 lens 504/448 e 0 to 0 dl 1788744353 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788744342.956846:0:6686:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa5ded80 with x1875634047507840 ext(0->8) 00010000:00010000:0.0:1788744342.956853:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.956866:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744342.956873:0:6686:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff940afa5ded80 00000100:00100000:1.0:1788744342.970685:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.971653:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047507968 00000100:00100000:3.0:1788744342.971669:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047507968 00010000:00010000:3.0:1788744342.971756:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744342.971879:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00100000:3.0:1788744342.971890:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047507968:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744342.971911:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788744342.971936:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788744342.971940:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788744342 00002000:00010000:3.0:1788744342.971942:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788744342 00002000:00010000:3.0:1788744342.971944:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788744342 00010000:00010000:3.0:1788744342.971949:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.971963:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.971995:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b953d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576147d expref: 9 pid: 6682 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.972018:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744342.972023:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744342.972029:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.972041:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.972100:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744342.972178:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1cb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2353:x1875634047507968:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 288us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744342.972185:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 75 00010000:00010000:0.0:1788744342.974793:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974815:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974869:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974878:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974887:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974894:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744342.974899:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974909:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974932:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744342.974940:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be526e6c/0x7cd2bfd5e1b95415 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744342.975106:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2351:x1875634047507712:12345-192.168.204.56@tcp:1:lfs.0 Request processed in 28135us (30232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744342.975116:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:1.0:1788744342.980772:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744342.981352:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047508224 00000100:00100000:3.0:1788744342.981364:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047508224 00000100:00100000:3.0:1788744342.981423:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 56 00000100:00100000:3.0:1788744342.981435:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8695850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+43:11578:x1875634047508224:12345-192.168.204.56@tcp:35:lfs.0 00000004:00010000:3.0:1788744342.981510:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761492 expref: 43 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744342.982116:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788744342.982169:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788744342.982507:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788744342.982584:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.982602:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 47 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.982612:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.982649:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 47 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744342.982663:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 47 pid: 10823 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744342.982695:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068471296:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744342.982797:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620900 going to sleep for 11 seconds 00000100:00100000:3.0:1788744342.994954:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5dd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5840:1875634068471296:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744342.994987:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744343.004638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.004786:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047508352 00000100:00100000:2.0:1788744343.004797:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047508352 00010000:00010000:2.0:1788744343.004860:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 48 pid: 10823 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.004904:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 76 00000100:00100000:2.0:1788744343.004915:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+48:2354:x1875634047508352:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744343.004931:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744343.004939:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 48 pid: 10823 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.004952:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 48 pid: 10823 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.004976:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b953c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576146f expref: 48 pid: 10823 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.004995:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:2.0:1788744343.005016:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.005026:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.005034:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788744343.005177:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788744343.005212:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744343.005281:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+47:2354:x1875634047508352:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 367us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.005290:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 76 00010000:00010000:1.0:1788744343.011042:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.011062:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744343.011243:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788744343.011506:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788744343.011909:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068471424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744343.011992:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744343.012039:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788744343.012183:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068471424 00000100:00100000:2.0:1788744343.012193:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068471424 00000100:00100000:2.0:1788744343.012267:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744343.012278:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068471424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744343.012369:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068471424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.012378:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788744343.012926:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744343.013028:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068471424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744343.013942:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788744343.014031:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068471552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788744343.014087:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744343.014427:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788744343.015404:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068471552 00000100:00100000:2.0:1788744343.015416:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068471552 00000100:00100000:2.0:1788744343.015542:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744343.015579:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875634068471552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788744343.015840:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace4cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875634068471552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 288us (1750us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788744343.015848:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744343.015950:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5840:1875634068471552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788744343.016029:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788744343.016074:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016083:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016090:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016103:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fce00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744343.016108:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016115:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016131:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:1.0:1788744343.016134:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788744343.016139:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.016146:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b9541c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788744343.016377:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788744343.017324:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788744343.017339:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 415149789584ns, next at 416149786962ns, rc = 0 00000001:00080000:1.0:1788744343.017349:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788744343.017409:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ad90afc00) 00010000:00010000:1.0:1788744343.017425:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788744343.017436:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95407 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761492 expref: 51 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744343.017634:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8695850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+50:11578:x1875634047508224:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 36199us (36870us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788744343.017647:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 56 00000020:00080000:1.0:1788744343.017655:0:5840:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788744343.020634:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.020722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047508480 00000100:00100000:2.0:1788744343.020732:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047508480 00000100:00100000:2.0:1788744343.020811:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 202 00000100:00100000:2.0:1788744343.020822:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+50:11578:x1875634047508480:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744343.020851:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744343.020873:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761499 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.020938:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761499 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.020952:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95423 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761499 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.020969:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.020972:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744343.020976:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388c00, rc 0) 00000100:00100000:2.0:1788744343.021045:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+51:11578:x1875634047508480:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 223us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.021051:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 202 00000100:00100000:3.0:1788744343.025065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744343.025520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047508736 00000100:00100000:1.0:1788744343.025535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047508736 00000100:00100000:1.0:1788744343.025644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744343.025656:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+51:11578:x1875634047508736:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:1.0:1788744343.026029:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+52:11578:x1875634047508736:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 373us (980us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788744343.026037:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 57 00000100:00100000:1.0:1788744343.165224:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.165413:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047508864 00000100:00100000:3.0:1788744343.165424:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047508864 00000100:00100000:3.0:1788744343.165495:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 203 00000100:00100000:3.0:1788744343.165516:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+52:11588:x1875634047508864:12345-192.168.204.56@tcp:34:lfs.0 00010000:00010000:3.0:1788744343.165649:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165674:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165688:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165706:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165714:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165720:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165870:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165878:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165885:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744343.165930:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165945:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165952:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165959:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165966:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.165970:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165977:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.165991:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744343.165994:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.165999:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166012:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9542a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166029:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166035:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166041:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166045:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.166048:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166054:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166061:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad8818b00) 00010000:00010000:3.0:1788744343.166064:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.166066:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166071:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166086:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166092:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166105:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166110:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fce00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.166112:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166117:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166125:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744343.166127:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.166129:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.166135:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744343.166225:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+52:11588:x1875634047508864:12345-192.168.204.56@tcp:34:lfs.0 Request processed in 711us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744343.166234:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 203 00000100:00100000:2.0:1788744343.239530:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744343.239726:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047509120 00000100:00100000:1.0:1788744343.239739:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047509120 00000100:00100000:1.0:1788744343.239808:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 204 00000100:00100000:1.0:1788744343.239822:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+52:11591:x1875634047509120:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744343.239846:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744343.239867:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b9543f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614a0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.239951:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.239985:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.239998:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240013:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240020:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240025:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240162:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240170:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240177:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744343.240188:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788744343.240707:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240717:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240724:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240738:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744343.240743:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240750:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240763:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744343.240766:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744343.240770:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240776:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240791:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240797:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240803:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240808:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744343.240811:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240817:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240836:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac3570700) 00010000:00010000:1.0:1788744343.240838:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744343.240842:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240847:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b9544d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240894:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b9543f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a0 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240908:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a0 expref: 54 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.240915:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744343.240917:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744343.240920:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3400, rc 0) 00000100:00100000:1.0:1788744343.241065:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+54:11591:x1875634047509120:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1245us (1548us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788744343.241072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 204 00000100:00100000:1.0:1788744343.251702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.252001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047509248 00000100:00100000:3.0:1788744343.252013:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047509248 00000100:00100000:3.0:1788744343.252086:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 205 00000100:00100000:3.0:1788744343.252107:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+54:11591:x1875634047509248:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:3.0:1788744343.252178:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252197:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252221:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252252:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252259:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252267:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252273:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fce00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.252277:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252285:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252297:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744343.252300:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744343.252305:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.252311:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b95462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744343.252393:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+54:11591:x1875634047509248:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 297us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744343.252401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 205 00000100:00100000:0.0:1788744343.269093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.269335:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047509504 00000100:00100000:3.0:1788744343.269363:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047509504 00000100:00100000:3.0:1788744343.269439:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 58 00000100:00100000:3.0:1788744343.269451:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+54:11591:x1875634047509504:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:3.0:1788744343.269806:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+55:11591:x1875634047509504:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 356us (724us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788744343.269815:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 58 00010000:00010000:1.0:1788744343.271304:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744343.455679:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.455788:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047509760 00000100:00100000:2.0:1788744343.455799:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047509760 00000100:00100000:2.0:1788744343.455862:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 206 00000100:00100000:2.0:1788744343.455874:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+55:11601:x1875634047509760:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744343.455902:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744343.455906:0:10823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788744343.455936:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b953e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761484 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.455974:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:2.0:1788744343.455981:0:10823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744343.455998:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614a7 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.456119:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b95470 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.456134:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b95470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.456144:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b95470 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744343.456156:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788744343.456295:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b95469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a7 expref: 57 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.456310:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b95470 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a7 expref: 56 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.456317:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.456320:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744343.456322:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744343.456629:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+56:11601:x1875634047509760:12345-192.168.204.56@tcp:101:bash.0 Request processed in 756us (959us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788744343.456637:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 206 00000100:00100000:0.0:1788744343.464723:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.464861:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510016 00000100:00100000:2.0:1788744343.464882:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510016 00000100:00100000:2.0:1788744343.464944:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 207 00000100:00100000:2.0:1788744343.464955:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+56:11601:x1875634047510016:12345-192.168.204.56@tcp:36:bash.0 00010000:00010000:2.0:1788744343.465016:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788744343.465043:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b95470 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a7 expref: 56 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.465068:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614a0 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.465091:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.465101:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744343.465321:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.465335:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.465343:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788744343.465392:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788744343.465415:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000086a87170 reply state 000000002e543e6f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.465424:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744343.465526:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+57:11601:x1875634047510016:12345-192.168.204.56@tcp:36:bash.0 Request processed in 573us (823us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788744343.465533:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 207 00000020:00080000:2.0:1788744343.465613:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788744343.469934:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:3.0:1788744343.470118:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470131:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470140:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470146:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.470150:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470159:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470179:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744343.470182:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.470187:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.470192:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389800/0x7cd2bfd5e1b9547e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.471156:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510144 00000100:00100000:2.0:1788744343.471174:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510144 00000100:00100000:2.0:1788744343.471257:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 208 00000100:00100000:2.0:1788744343.471272:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+56:11601:x1875634047510144:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744343.471305:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744343.471327:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614ae expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471421:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471436:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471449:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744343.471495:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788744343.471500:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744343.471526:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471588:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 58 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471620:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.471628:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.471646:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744343.471649:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744343.471726:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+57:11601:x1875634047510144:12345-192.168.204.56@tcp:101:bash.0 Request processed in 448us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.471734:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 208 00000100:00100000:1.0:1788744343.477417:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.477536:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510400 00000100:00100000:3.0:1788744343.477855:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510400 00000100:00100000:3.0:1788744343.477949:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:3.0:1788744343.477961:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+57:11601:x1875634047510400:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:3.0:1788744343.478244:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+58:11601:x1875634047510400:12345-192.168.204.56@tcp:35:bash.0 Request processed in 283us (837us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788744343.478253:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 59 00000100:00100000:0.0:1788744343.578156:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.578841:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510528 00000100:00100000:2.0:1788744343.578855:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510528 00000100:00100000:2.0:1788744343.578923:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 209 00000100:00100000:2.0:1788744343.578934:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+58:11607:x1875634047510528:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744343.578958:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744343.578978:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614b5 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579045:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579060:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579074:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744343.579131:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788744343.579135:0:10823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744343.579154:0:10823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579179:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388600/0x7cd2bfd5e1b95493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614b5 expref: 60 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579218:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614b5 expref: 59 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.579227:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:2.0:1788744343.579230:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744343.579234:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744343.579304:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047510528:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 371us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.580480:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 209 00000100:00100000:0.0:1788744343.590401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.590590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510656 00000100:00100000:3.0:1788744343.590600:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510656 00000100:00100000:3.0:1788744343.590667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 210 00000100:00100000:3.0:1788744343.590679:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047510656:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744343.590708:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744343.590745:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614bc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590820:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590835:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590848:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590864:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590871:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.590878:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591006:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591015:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591022:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744343.591063:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788744343.591069:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744343.591091:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591911:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591920:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591928:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591935:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591942:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.591945:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591953:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591979:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744343.591981:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.591986:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.591991:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b954a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592005:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592009:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592015:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592019:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744343.592022:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592028:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592035:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ad8818b00) 00010000:00010000:3.0:1788744343.592037:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744343.592040:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592047:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b954af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592224:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592244:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.592253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744343.592255:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744343.592258:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fde00, rc 0) 00000100:00100000:3.0:1788744343.593544:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad050b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+60:11607:x1875634047510656:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 2860us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744343.593587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 210 00000100:00100000:3.0:1788744343.619029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.619116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744343.619262:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047510912 00000100:00100000:1.0:1788744343.619274:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047510912 00000100:00100000:1.0:1788744343.619350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 211 00000100:00100000:1.0:1788744343.619361:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+60:11607:x1875634047510912:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744343.619396:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744343.619418:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614c3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619529:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619546:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619604:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619621:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619656:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619671:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744343.619685:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068471680:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744343.619792:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.619802:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744343.619826:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068471808:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744343.619853:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788744343.620468:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511040 00000100:00100000:2.0:1788744343.620475:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511040 00010000:00010000:2.0:1788744343.620502:0:5821:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 62 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.620530:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:2.0:1788744343.620539:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+62:2353:x1875634047511040:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744343.620601:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744343.620618:0:5821:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 62 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.620631:0:5821:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 62 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.620651:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.620656:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.620671:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.620678:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744343.620717:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+62:2353:x1875634047511040:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 178us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.620724:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:3.0:1788744343.633491:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00010000:00010000:1.0:1788744343.633693:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.56@tcp) returned -22 from blocking AST (req@0000000082fd191a x1875634068471680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.633716:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b954b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614bc expref: 61 pid: 5838 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744343.633736:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068471680:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744343.633749:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068471808:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744343.633774:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744343.633780:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.633789:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.633799:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.635139:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511168 00000100:00100000:2.0:1788744343.635151:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511168 00010000:00010000:2.0:1788744343.635204:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.635253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:2.0:1788744343.635264:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+61:2353:x1875634047511168:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744343.635283:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744343.635290:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635305:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635343:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b9548c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ae expref: 61 pid: 6704 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635361:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.635366:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635397:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635404:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.635436:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744343.635515:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+60:2353:x1875634047511168:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 251us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.635523:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 78 00010000:00010000:1.0:1788744343.636118:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.636128:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744343.636160:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788744343.636323:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.636345:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.636353:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744343.636356:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744343.636358:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3000, rc 0) 00000100:00100000:1.0:1788744343.636399:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+60:11607:x1875634047510912:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 17040us (17381us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788744343.636408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 211 00000100:00100000:0.0:1788744343.651570:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.652088:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511424 00000100:00100000:2.0:1788744343.652099:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511424 00000100:00100000:2.0:1788744343.652404:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:2.0:1788744343.652417:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+60:11607:x1875634047511424:12345-192.168.204.56@tcp:103:lfs.0 00010000:00010000:2.0:1788744343.652435:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744343.652473:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b95423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761499 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.652493:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.652498:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744343.652611:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047511424:12345-192.168.204.56@tcp:103:lfs.0 Request processed in 196us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.652620:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:2.0:1788744343.655868:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744343.656034:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511552 00000100:00100000:1.0:1788744343.656047:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511552 00000100:00100000:1.0:1788744343.656132:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 212 00000100:00100000:1.0:1788744343.656143:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047511552:12345-192.168.204.56@tcp:58:lfs.0 00010000:00010000:1.0:1788744343.656262:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.656279:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744343.656291:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744343.656608:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788744343.656957:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047511552:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 813us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744343.656966:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 212 00000100:00100000:0.0:1788744343.662426:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744343.662524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511680 00000100:00100000:3.0:1788744343.662537:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511680 00000100:00100000:3.0:1788744343.662632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 213 00000100:00100000:3.0:1788744343.662643:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+59:11607:x1875634047511680:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:3.0:1788744343.662665:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744343.662685:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614ca expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662745:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662756:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662793:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662808:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662823:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744343.662825:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788744343.662830:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744343.662837:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fce00, rc 0) 00000100:00100000:3.0:1788744343.662897:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+60:11607:x1875634047511680:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 256us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744343.662904:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 213 00000040:00080000:2.0:1788744343.962919:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744343.962929:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744343.962996:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788744343.963010:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744343.963164:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b31c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068471936:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744343.963290:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091780 going to sleep for 11 seconds 00000100:00100000:2.0:1788744343.968625:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b31c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068471936:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788744343.972110:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744343.973227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511808 00000100:00100000:1.0:1788744343.973242:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511808 00000100:00100000:1.0:1788744343.973433:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 214 00000100:00100000:1.0:1788744343.973445:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+60:11608:x1875634047511808:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744343.973495:0:5837:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744343.973687:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+60:11608:x1875634047511808:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 243us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744343.973696:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 214 00000100:00100000:0.0:1788744343.982955:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744343.991986:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047511936 00000100:00100000:2.0:1788744343.992004:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047511936 00000100:00100000:2.0:1788744343.992097:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 215 00000100:00100000:2.0:1788744343.992108:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+60:11608:x1875634047511936:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788744343.992190:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992223:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992239:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992300:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992308:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992327:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992353:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992382:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992391:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744343.992442:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788744343.992446:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744343.992472:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.992483:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996463:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996473:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996480:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744343.996679:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996692:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996712:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:2.0:1788744343.996715:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744343.996720:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996752:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b954e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996775:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996781:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996787:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996792:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744343.996795:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996801:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996809:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff940ac2bbc100) 00010000:00010000:2.0:1788744343.996811:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744343.996814:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996820:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b954e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996840:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996845:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996857:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996862:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744343.996865:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996870:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996879:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:2.0:1788744343.996881:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744343.996884:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744343.996890:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b954ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744343.997002:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+60:11608:x1875634047511936:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 Request processed in 4891us (14055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744343.997012:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 215 00000100:00100000:3.0:1788744344.008717:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744344.010437:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047512192 00000100:00100000:0.0:1788744344.010468:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047512192 00000100:00100000:0.0:1788744344.010579:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 216 00000100:00100000:0.0:1788744344.010591:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+60:11608:x1875634047512192:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744344.010628:0:10823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744344.010652:0:10823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b954f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614d1 expref: -99 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010757:0:10823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010773:0:10823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010808:0:10823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744344.010823:0:10823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788744344.010926:0:10823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010934:0:10823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010941:0:10823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010947:0:10823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744344.010952:0:10823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010959:0:10823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010971:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:0.0:1788744344.010974:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744344.010979:0:10823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.010986:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b954fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.011025:0:10823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b954f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614d1 expref: 62 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.011047:0:10823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:0.0:1788744344.011050:0:10823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788744344.011054:0:10823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b954f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614d1 expref: 62 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.011063:0:10823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76c00, rc 0) 00000100:00100000:0.0:1788744344.011132:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512192:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 543us (2423us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788744344.011140:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 216 00000100:00100000:2.0:1788744344.018157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.018259:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047512320 00000100:00100000:3.0:1788744344.018272:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047512320 00000100:00100000:3.0:1788744344.018339:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 217 00000100:00100000:3.0:1788744344.018351:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788744344.018391:0:6704:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788744344.018520:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512320:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 171us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.018528:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 217 00000100:00100000:2.0:1788744344.042366:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.042467:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047512576 00000100:00100000:3.0:1788744344.042492:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047512576 00000100:00100000:3.0:1788744344.042607:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 218 00000100:00100000:3.0:1788744344.042617:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512576:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.042643:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744344.042646:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788744344.042674:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388e00/0x7cd2bfd5e1b9549a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614b5 expref: 61 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.042695:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:3.0:1788744344.042700:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744344.042724:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9550a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614d8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744344.043166:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788744344.044186:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.044202:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.044224:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.044276:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9550a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614d8 expref: 63 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.044293:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614d8 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.044315:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:3.0:1788744344.044318:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788744344.044321:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc400, rc 0) 00000100:00100000:3.0:1788744344.044390:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+62:11608:x1875634047512576:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1773us (2033us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788744344.044398:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 218 00000100:00100000:0.0:1788744344.063070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.063178:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047512832 00000100:00100000:3.0:1788744344.063189:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047512832 00000100:00100000:3.0:1788744344.063363:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 219 00000100:00100000:3.0:1788744344.063907:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+62:11608:x1875634047512832:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.063970:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744344.063998:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614d8 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.064019:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818b00) 00010000:00010000:3.0:1788744344.065497:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744344.066733:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066756:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066768:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066838:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066847:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066854:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066921:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066928:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066935:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066942:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744344.066946:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066953:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066964:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:2.0:1788744344.066967:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744344.066971:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066978:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388400/0x7cd2bfd5e1b9551f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.066997:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067003:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067009:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067013:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744344.067016:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067035:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067043:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9f637e48 (ffff940ac2bbc100) 00010000:00010000:2.0:1788744344.067045:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744344.067048:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.067054:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388800/0x7cd2bfd5e1b95526 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9f637e48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744344.067158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512832:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 3781us (4094us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788744344.067167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 219 00000100:00100000:2.0:1788744344.071267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.071829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047512960 00000100:00100000:3.0:1788744344.071841:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047512960 00000100:00100000:3.0:1788744344.071894:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 220 00000100:00100000:3.0:1788744344.071904:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+61:11608:x1875634047512960:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.071924:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744344.071946:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9552d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614df expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.071984:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.072012:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.072216:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.072360:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9552d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.072381:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.072390:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:0.0:1788744344.072393:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788744344.072399:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fde00, rc 0) 00000100:00100000:0.0:1788744344.072470:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+62:11608:x1875634047512960:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 566us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744344.072478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 220 00000100:00100000:2.0:1788744344.079206:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.079303:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047513216 00000100:00100000:3.0:1788744344.079313:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047513216 00000100:00100000:3.0:1788744344.079366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 221 00000100:00100000:3.0:1788744344.079376:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+62:11608:x1875634047513216:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.079523:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.079543:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.079637:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744344.080092:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788744344.080101:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416212551484ns, next at 417212549354ns, rc = 0 00000004:00010000:3.0:1788744344.080198:0:5836:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000314e5c27 reply state 00000000dbec7d37 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.080209:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744344.080309:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+64:11608:x1875634047513216:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 933us (1114us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788744344.080317:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 221 00010000:00010000:1.0:1788744344.084396:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084414:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084422:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084429:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.084434:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084441:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084468:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:1.0:1788744344.084472:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788744344.084486:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.084493:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b9553b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744344.090504:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744344.090648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047513344 00000100:00100000:0.0:1788744344.090658:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047513344 00000100:00100000:0.0:1788744344.090720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 222 00000100:00100000:0.0:1788744344.090730:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+63:11608:x1875634047513344:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744344.090760:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744344.090780:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614e6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.090846:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.090861:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.090879:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:0.0:1788744344.090883:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744344.090887:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77e00, rc 0) 00000100:00100000:0.0:1788744344.090943:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+64:11608:x1875634047513344:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 214us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744344.090951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 222 00000100:00100000:0.0:1788744344.102416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.107067:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047513472 00000100:00100000:2.0:1788744344.107084:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047513472 00000100:00100000:2.0:1788744344.107181:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:2.0:1788744344.107192:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047513472:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788744344.107493:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+10:2353:x1875634047513472:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 302us (5086us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788744344.107501:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00080000:0.0:1788744344.108713:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744344.132402:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.132528:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047513728 00000100:00100000:1.0:1788744344.132538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047513728 00000100:00100000:1.0:1788744344.132641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:1.0:1788744344.132652:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+64:11608:x1875634047513728:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788744344.132880:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+65:11608:x1875634047513728:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 230us (495us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788744344.132888:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 60 00000100:00100000:3.0:1788744344.140839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.141019:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047513984 00000100:00100000:2.0:1788744344.141032:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047513984 00000100:00100000:2.0:1788744344.141116:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 223 00000100:00100000:2.0:1788744344.141128:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+65:11608:x1875634047513984:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788744344.141250:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+65:11608:x1875634047513984:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 124us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.141258:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 223 00000100:00100000:0.0:1788744344.144798:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.145009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514112 00000100:00100000:3.0:1788744344.145019:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514112 00000100:00100000:3.0:1788744344.145087:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 224 00000100:00100000:3.0:1788744344.145099:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+65:11608:x1875634047514112:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.145123:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744344.145151:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95549 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614ed expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145227:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145242:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145252:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744344.145286:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744344.145305:0:5836:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145331:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95549 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ed expref: 67 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145348:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ed expref: 66 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.145355:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:3.0:1788744344.145358:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788744344.145361:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc800, rc 0) 00000100:00100000:3.0:1788744344.145461:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+66:11608:x1875634047514112:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 364us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.145467:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 224 00000100:00100000:1.0:1788744344.152942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.153051:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514240 00000100:00100000:2.0:1788744344.153061:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514240 00000100:00100000:2.0:1788744344.153128:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:2.0:1788744344.153139:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+10:2354:x1875634047514240:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744344.153162:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744344.153183:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614f4 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744344.153213:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1297, blocks: 0x1 00010000:00010000:2.0:1788744344.153235:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788744344.153240:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744344.153264:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.153289:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.153304:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388e00, rc 0) 00000100:00100000:2.0:1788744344.153419:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+11:2354:x1875634047514240:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 282us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.153426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:2.0:1788744344.159020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.161272:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514496 00000100:00100000:1.0:1788744344.161289:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514496 00000100:00100000:1.0:1788744344.161461:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 225 00000100:00100000:1.0:1788744344.161475:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+66:11608:x1875634047514496:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744344.161628:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+66:11608:x1875634047514496:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 156us (2622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.161636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 225 00000100:00100000:0.0:1788744344.171772:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.171929:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514624 00000100:00100000:2.0:1788744344.171942:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514624 00000100:00100000:2.0:1788744344.172013:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:2.0:1788744344.172027:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+11:11608:x1875634047514624:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744344.172047:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744344.172065:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57614fb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.172097:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.172107:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744344.172112:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744344.172117:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.172183:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.172204:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744344.172220:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068472064:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744344.172385:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744344.181263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.181384:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b32680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068472064:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744344.181423:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.181459:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389800, rc 0) 00000100:00100000:2.0:1788744344.181525:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+12:11608:x1875634047514624:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 9500us (9765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.181529:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514752 00000100:00100000:2.0:1788744344.181535:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:3.0:1788744344.181539:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514752 00010000:00010000:3.0:1788744344.181599:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.181639:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:3.0:1788744344.181652:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+12:2353:x1875634047514752:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744344.181668:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744344.181917:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.181931:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.181956:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614f4 expref: 12 pid: 6682 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.181970:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744344.181974:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744344.181982:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.181993:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.182042:0:6695:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.182057:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6695:1875634068472192:192.168.204.56@tcp:105: 00000100:00100000:3.0:1788744344.182112:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac1377b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788744344.187586:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5dc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6695:1875634068472192:192.168.204.56@tcp:105: 00010000:00010000:3.0:1788744344.187628:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744344.187688:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+11:2353:x1875634047514752:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 6039us (6434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.187699:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:0.0:1788744344.196236:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.196692:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047514880 00000100:00100000:2.0:1788744344.196703:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047514880 00002000:00100000:2.0:1788744344.196761:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff940af73ab480 x1875634047514880/t0(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:620/0 lens 504/0 e 0 to 0 dl 1788744355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744344.196775:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940af73ab480 with x1875634047514880 ext(0->12) 00002000:00010000:2.0:1788744344.196782:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940af73ab480 00000100:00100000:2.0:1788744344.196815:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:2.0:1788744344.196841:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+11:2354:x1875634047514880:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788744344.198014:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:2354:x1875634047514880:12345-192.168.204.56@tcp:4:lhsmtool_posix.0 Request processed in 1169us (1783us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788744344.200885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.200968:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515008 00000100:00100000:3.0:1788744344.200980:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515008 00000100:00100000:2.0:1788744344.201210:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00002000:00100000:2.0:1788744344.201228:0:6685:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff940af73ab480 x1875634047514880/t4294967321(0) o4->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:620/0 lens 504/448 e 0 to 0 dl 1788744355 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788744344.201241:0:6685:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940af73ab480 with x1875634047514880 ext(0->12) 00002000:00010000:2.0:1788744344.201248:0:6685:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940af73ab480 00000100:00100000:3.0:1788744344.202839:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 226 00000100:00100000:3.0:1788744344.202873:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+66:11608:x1875634047515008:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788744344.260352:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:1.0:1788744344.260390:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ac663b840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788744344.260396:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ac7ea8900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ac663b0c0 00000020:00080000:1.0:1788744344.260400:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940ac7ea8e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940ace351400 00000001:00080000:1.0:1788744344.260461:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788744344.260474:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788744344.260493:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ad31cc240 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788744344.260496:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940adbea3200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ad31cc900 00000020:00080000:1.0:1788744344.260499:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940adbea3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940afa86d400 00000004:00080000:1.0:1788744344.260569:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788744344.260584:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:1.0:1788744344.260842:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068472320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788744344.260933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744344.260985:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068472448:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788744344.261010:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744344.261302:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788744344.261310:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068472576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788744344.261332:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744344.261374:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068472320 00000100:00100000:1.0:1788744344.261383:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068472320 00000100:00100000:1.0:1788744344.261438:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068472448 00000100:00100000:1.0:1788744344.261440:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068472448 00000100:00100000:1.0:1788744344.261481:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068472576 00000100:00100000:1.0:1788744344.261484:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068472576 00000100:00100000:1.0:1788744344.261498:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744344.261507:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad81e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3313:x1875634068472320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788744344.261538:0:11969:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:3.0:1788744344.261780:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+20:11608:x1875634047515008:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 Request processed in 58921us (60900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.261790:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 226 00002000:00010000:1.0:1788744344.261861:0:11969:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e1296, atime: 0x6a9e1296, ctime: 0x6a9e1296, blocks: 0x1 00010000:00010000:1.0:1788744344.261870:0:11969:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.261904:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1788744344.261909:0:11969:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744344.261916:0:11969:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.261935:0:11969:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.261946:0:11969:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.261955:0:11969:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.261982:0:11969:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1788744344.262102:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788744344.262296:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788744344.264016:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744344.264036:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.264051:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744344.264056:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.264087:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.264108:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.264116:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087458585/0x7cd2bfd5e1b95565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.264140:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744344.264142:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744344.264144:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744344.265239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.266021:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad81e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1875634068472320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4511us (5085us total) trans 4294967310 rc 0/0 00000004:00080000:3.0:1788744344.266273:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940b00b73800/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788744344.266282:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068472320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788744344.266326:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744344.266501:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515136 00000100:00100000:1.0:1788744344.266508:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515136 00000100:00100000:0.0:1788744344.266750:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788744344.266763:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634068472448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788744344.266796:0:8624:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788744344.266820:0:8624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.266850:0:8624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 13 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.266859:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788744344.266863:0:8624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788744344.266868:0:8624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.266907:0:8624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 13 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.266923:0:8624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 13 pid: 8624 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744344.266937:0:8624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068472704:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744344.270244:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788744344.270273:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634068472576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788744344.270503:0:11969:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788744344.270507:0:11969:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788744343 00002000:00010000:1.0:1788744344.270510:0:11969:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788744344.270513:0:11969:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788744343 -> 1788744343 00002000:00010000:1.0:1788744344.270528:0:11969:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788744344.270740:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:3.0:1788744344.270751:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+13:2351:x1875634047515136:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788744344.270881:0:8624:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788744344.271010:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1875634068472576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 752us (9675us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788744344.271018:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788744344.271052:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788744344.271157:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940b00b72680/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788744344.271163:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068472576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788744344.277688:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744344.277766:0:8624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8624:1875634068472704:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744344.277799:0:8624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.278333:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515264 00000100:00100000:3.0:1788744344.278345:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515264 00010000:00010000:3.0:1788744344.278407:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 14 pid: 8624 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.278469:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 80 00000100:00100000:3.0:1788744344.278480:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+14:2354:x1875634047515264:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744344.278511:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744344.278519:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 14 pid: 8624 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.278533:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 14 pid: 8624 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.278578:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af147dc5/0x7cd2bfd5e1b95327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576145a expref: 14 pid: 8624 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.278608:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744344.278612:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744344.278618:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.278630:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.278658:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744344.278742:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+13:2354:x1875634047515264:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 263us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.278749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 80 00010000:00010000:0.0:1788744344.280342:0:8624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280374:0:8624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280387:0:8624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280396:0:8624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280421:0:8624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744344.280438:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744344.280457:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280466:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744344.280470:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280479:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280500:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280507:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd88c801/0x7cd2bfd5e1b9556c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.280530:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744344.280532:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744344.280534:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744344.281243:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1875634068472448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14479us (20228us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788744344.281253:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788744344.281308:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940b00b71f80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788744344.281314:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068472448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788744344.290488:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744344.321079:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03c88f08-96bd-4666-9af8-74d11f561443+12:2351:x1875634047515136:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 Request processed in 50319us (55833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744344.321092:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 69 00000001:00080000:1.0:1788744344.321246:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1788744344.321258:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1788744344.321263:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1788744344.324186:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.324299:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515520 00000100:00100000:2.0:1788744344.324309:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515520 00000100:00100000:2.0:1788744344.324403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 227 00000100:00100000:2.0:1788744344.324416:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+20:11608:x1875634047515520:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788744344.324483:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744344.324510:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc800/0x7cd2bfd5e1b95550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ed expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.324530:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:2.0:1788744344.324844:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744344.324975:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.324991:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.325017:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744344.325333:0:5838:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002286b295 reply state 00000000aeefe028 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.325343:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744344.325517:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+21:11608:x1875634047515520:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 1102us (1339us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788744344.325526:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 227 00000100:00100000:2.0:1788744344.328217:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744344.328379:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515648 00000100:00100000:0.0:1788744344.328389:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515648 00000100:00100000:0.0:1788744344.329261:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 70 00000100:00100000:0.0:1788744344.329277:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047515648:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788744344.329576:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788744344.329581:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788744343 -> 1788744343 00002000:00010000:0.0:1788744344.329584:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788744342 00002000:00010000:0.0:1788744344.329586:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788744343 -> 1788744343 00002000:00010000:0.0:1788744344.329589:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788744344.329664:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047515648:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 391us (1453us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788744344.329673:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 70 00010000:00010000:3.0:1788744344.333271:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333290:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333300:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333312:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744344.333318:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333327:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333347:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:3.0:1788744344.333350:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744344.333355:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.333387:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95573 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744344.334837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.334962:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047515904 00000100:00100000:1.0:1788744344.334973:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047515904 00000100:00100000:1.0:1788744344.335043:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 228 00000100:00100000:1.0:1788744344.335056:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+20:11608:x1875634047515904:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788744344.335127:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.335145:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.335155:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.335192:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.335204:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 20 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.335219:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068472832:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744344.335362:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744344.338692:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.338904:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068472832:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744344.338932:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744344.339149:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516032 00000100:00100000:0.0:1788744344.339156:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516032 00010000:00010000:0.0:1788744344.339189:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 21 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744344.339254:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:0.0:1788744344.339264:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+21:2353:x1875634047516032:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744344.339282:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744344.339290:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 21 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339302:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 21 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339324:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fde00/0x7cd2bfd5e1b95534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614df expref: 21 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339341:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:0.0:1788744344.339346:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339356:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339364:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.339394:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744344.339475:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d78850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03c88f08-96bd-4666-9af8-74d11f561443+20:2353:x1875634047516032:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 211us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744344.339482:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 81 00010000:00010000:1.0:1788744344.339570:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339577:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339617:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339625:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339632:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339639:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3e00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.339643:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339654:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339664:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:1.0:1788744344.339667:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788744344.339671:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.339689:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b9557a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.339742:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+19:11608:x1875634047515904:12345-192.168.204.56@tcp:55:lhsmtool_posix.0 Request processed in 4688us (4913us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788744344.339750:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 228 00000100:00100000:3.0:1788744344.341767:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.341828:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516160 00000100:00100000:1.0:1788744344.341838:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516160 00000100:00100000:1.0:1788744344.341899:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:1.0:1788744344.341909:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047516160:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788744344.341953:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.341978:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.341988:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744344.341992:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788744344.341997:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.342028:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.342042:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 8 pid: 6681 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.342074:0:6681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068472960:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744344.342191:0:6681:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744344.343901:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.343973:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516288 00000100:00100000:3.0:1788744344.343981:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516288 00010000:00010000:3.0:1788744344.344016:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 9 pid: 6681 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.344064:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:3.0:1788744344.344075:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047516288:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744344.344095:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744344.344123:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 9 pid: 6681 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.344136:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 9 pid: 6681 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.344162:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744344.344167:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788744344.344174:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.344185:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.344224:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744344.344317:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b33b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+9:2353:x1875634047516288:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 243us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.344325:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 82 00010000:00010000:1.0:1788744344.344540:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9555e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614fb expref: 8 pid: 6681 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.344578:0:6681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1875634068472960:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744344.344602:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344612:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344619:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344644:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344653:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344662:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344683:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744344.344688:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344697:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344710:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.344718:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95581 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.345991:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047516160:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 Request processed in 4075us (4222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.346004:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 71 00000100:00100000:2.0:1788744344.349484:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.349575:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516544 00000100:00100000:3.0:1788744344.349584:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516544 00000100:00100000:3.0:1788744344.349642:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 229 00000100:00100000:3.0:1788744344.349651:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+19:11608:x1875634047516544:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788744344.349746:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.349764:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.349777:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.350036:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.350048:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.350059:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.350093:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.350118:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 20 pid: 5838 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.350135:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5df100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068473088:192.168.204.56@tcp:104: 00000100:00100000:3.0:1788744344.350226:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744344.355261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.355356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516672 00000100:00100000:2.0:1788744344.355366:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516672 00010000:00010000:2.0:1788744344.355414:0:6695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 21 pid: 5838 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744344.355480:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 83 00000100:00100000:2.0:1788744344.355490:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+21:2353:x1875634047516672:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744344.355506:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744344.355513:0:6695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 21 pid: 5838 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.355528:0:6695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 21 pid: 5838 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.355616:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:2.0:1788744344.355623:0:6695:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.355634:0:6695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.355645:0:6695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.355668:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744344.355748:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+21:2353:x1875634047516672:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 258us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.355757:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 83 00010000:00010000:3.0:1788744344.356073:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77e00/0x7cd2bfd5e1b95542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614e6 expref: 20 pid: 5838 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.356090:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5df100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068473088:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744344.356111:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.356119:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.356126:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788744344.356321:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788744344.356475:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788744344.356520:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788744344.357997:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1875634068473216:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788744344.358079:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744344.358115:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7091840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744344.358190:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068473216 00000100:00100000:3.0:1788744344.358199:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068473216 00000100:00100000:3.0:1788744344.358249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788744344.358258:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6704:x1875634068473216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788744344.358345:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6704:x1875634068473216:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.358361:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744344.358436:0:6704:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788744344.358453:0:6704:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1788744344.358474:0:6704:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940b00b72680, transno 4294967322 00000100:00100000:1.0:1788744344.358495:0:6704:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff940b00b71f80 x1875634068472448/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788744360 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744344.358507:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1875634068473216:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788744344.359028:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788744344.359094:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1875634068473344:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788744344.359131:0:6704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744344.359147:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744344.359389:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068473344 00000100:00100000:2.0:1788744344.359396:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068473344 00000100:00100000:2.0:1788744344.359426:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788744344.359434:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6704:x1875634068473344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788744344.359672:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6704:x1875634068473344:12345-0@lo:1000:mdt00_003.0 Request processed in 238us (540us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788744344.359679:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744344.360528:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1875634068473344:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788744344.360619:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360631:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360641:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360647:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.360652:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360660:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360675:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad8818200) 00010000:00010000:1.0:1788744344.360678:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744344.360683:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360688:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b9558f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360882:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360890:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360908:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360914:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.360917:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360924:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360932:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744344.360935:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744344.360942:0:6704:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360954:0:6704:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360963:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.360996:0:6704:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.361065:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068473472:192.168.204.56@tcp:105: 00000100:00100000:1.0:1788744344.361154:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744344.365513:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.365736:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1875634068473472:192.168.204.56@tcp:105: 00010000:00010000:1.0:1788744344.365787:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365799:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b954d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365831:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365845:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365858:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365869:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365876:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365883:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365890:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.365895:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365902:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365914:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744344.365918:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744344.365932:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365939:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b95596 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365949:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365956:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365961:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365965:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.365968:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365974:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365981:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744344.365984:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744344.365987:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.365993:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b95588 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.366222:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+23:11608:x1875634047516544:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 16570us (16747us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788744344.366232:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 229 00000020:00080000:1.0:1788744344.366242:0:6704:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788744344.366329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047516800 00000100:00100000:2.0:1788744344.366338:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047516800 00000100:00100000:2.0:1788744344.366386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 61 00000100:00100000:2.0:1788744344.366397:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:11607:x1875634047516800:12345-192.168.204.56@tcp:49:lfs.0 00000100:00100000:2.0:1788744344.366502:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:11607:x1875634047516800:12345-192.168.204.56@tcp:49:lfs.0 Request processed in 107us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744344.366508:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 61 00000040:00080000:3.0:1788744344.366726:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744344.366731:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744344.367301:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788744344.367307:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744344.370519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.370673:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517056 00000100:00100000:3.0:1788744344.370686:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517056 00000100:00100000:3.0:1788744344.370751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 230 00000100:00100000:3.0:1788744344.370761:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+23:11607:x1875634047517056:12345-192.168.204.56@tcp:58:lfs.0 00000040:00080000:3.0:1788744344.371141:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788744344.371235:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+23:11607:x1875634047517056:12345-192.168.204.56@tcp:58:lfs.0 Request processed in 475us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.371243:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 230 00000100:00100000:0.0:1788744344.373884:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.373979:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517312 00000100:00100000:2.0:1788744344.373993:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517312 00000100:00100000:2.0:1788744344.374050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 62 00000100:00100000:2.0:1788744344.374062:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8696450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+23:11608:x1875634047517312:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788744344.374777:0:5839:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788744344.374882:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788744344.374930:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.374947:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.374959:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.374975:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.374982:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.374990:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744344.375004:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788744344.375110:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8696450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+25:11608:x1875634047517312:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 1049us (1232us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788744344.375119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 62 00000020:00080000:2.0:1788744344.375124:0:5839:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788744344.375465:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744344.375472:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.375480:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744344.375483:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.375492:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.375505:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff940ad0017600) 00010000:00010000:0.0:1788744344.375509:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788744344.375514:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.375520:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388c00/0x7cd2bfd5e1b9559d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744344.375535:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744344.375537:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744344.375538:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744344.411149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744344.411250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517440 00000100:00100000:1.0:1788744344.411261:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517440 00000100:00100000:1.0:1788744344.411331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 231 00000100:00100000:1.0:1788744344.411343:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+25:11610:x1875634047517440:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744344.411373:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744344.411406:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b955a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761502 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411503:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411521:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411534:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411610:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411619:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411627:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411928:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411939:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411959:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.411993:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.412008:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 26 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744344.412021:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068473600:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744344.412104:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31ccd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788744344.414811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744344.414949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517696 00000100:00100000:2.0:1788744344.414964:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517696 00000100:00100000:2.0:1788744344.415038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:2.0:1788744344.415050:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+27:5593:x1875634047517696:12345-192.168.204.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788744344.415355:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:5593:x1875634047517696:12345-192.168.204.56@tcp:35:ldlm_bl.0 Request processed in 306us (556us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788744344.415364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 63 00000100:00100000:1.0:1788744344.416122:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875634068473600:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744344.416154:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744344.417679:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744344.417823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517824 00000100:00100000:3.0:1788744344.417835:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517824 00010000:00010000:3.0:1788744344.417875:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 28 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744344.417925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 84 00000100:00100000:3.0:1788744344.417934:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+28:2353:x1875634047517824:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788744344.417949:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744344.417955:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 28 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.417968:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 28 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.418007:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3000/0x7cd2bfd5e1b954c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614c3 expref: 28 pid: 5837 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.418025:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744344.418030:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.418040:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.418048:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744344.418079:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744344.418128:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03c88f08-96bd-4666-9af8-74d11f561443+27:2353:x1875634047517824:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 194us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744344.418135:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 84 00010000:00010000:1.0:1788744344.418281:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418290:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744344.418339:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788744344.418343:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788744344.418362:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418377:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418399:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418405:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418412:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418419:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.418423:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418431:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418450:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744344.418453:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744344.418457:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418463:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418474:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418480:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418487:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418499:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744344.418502:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418509:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418517:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff940ac3570600) 00010000:00010000:1.0:1788744344.418519:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744344.418522:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418528:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418613:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3400/0x7cd2bfd5e1b955a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761502 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418629:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761502 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744344.418637:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744344.418640:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744344.418642:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2a00, rc 0) 00000100:00100000:1.0:1788744344.418677:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+26:11610:x1875634047517440:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 7337us (7543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744344.418685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 231 00000001:00080000:0.0:1788744345.227123:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788744345.227158:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1788744345.308063:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744345.371466:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788744345.371475:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744345.371514:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788744345.371520:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744345.371679:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068473728:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744345.371798:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004600 going to sleep for 11 seconds 00000100:00100000:2.0:1788744345.377199:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11681:1875634068473728:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744345.378124:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744345.378630:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047517952 00000100:00100000:2.0:1788744345.378642:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047517952 00000100:00100000:2.0:1788744345.378971:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 232 00000100:00100000:2.0:1788744345.378995:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:11621:x1875634047517952:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788744345.379040:0:6704:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788744345.379159:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+26:11621:x1875634047517952:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 166us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.379167:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 232 00000100:00100000:3.0:1788744345.386705:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744345.387215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047518208 00000100:00100000:1.0:1788744345.387235:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047518208 00000100:00100000:1.0:1788744345.387306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 233 00000100:00100000:1.0:1788744345.387317:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+26:11621:x1875634047518208:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744345.387340:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744345.387362:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761509 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.387978:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.387994:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.388007:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744345.388018:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788744345.388154:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2600/0x7cd2bfd5e1b955c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761509 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.388170:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761509 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.388179:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744345.388182:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744345.388186:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3c00, rc 0) 00000100:00100000:1.0:1788744345.388251:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:11621:x1875634047518208:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 936us (1567us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788744345.388259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 233 00000100:00080000:0.0:1788744345.388456:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744345.393317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744345.393449:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047518336 00000100:00100000:0.0:1788744345.393460:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047518336 00000100:00100000:0.0:1788744345.393529:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744345.393539:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+28:2354:x1875634047518336:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744345.393585:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744345.393609:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3c00/0x7cd2bfd5e1b955c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761509 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.393628:0:6695:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:0.0:1788744345.393633:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744345.393675:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03c88f08-96bd-4666-9af8-74d11f561443+27:2354:x1875634047518336:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744345.393692:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744345.397126:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744345.397704:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047518592 00000100:00100000:1.0:1788744345.397724:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047518592 00000100:00100000:1.0:1788744345.397787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 234 00000100:00100000:1.0:1788744345.397797:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+27:11621:x1875634047518592:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788744345.397874:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.397892:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.397906:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398093:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398101:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398108:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398113:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744345.398123:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398140:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398153:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744345.398157:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744345.398170:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744345.398177:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3800/0x7cd2bfd5e1b955d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744345.398330:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+28:11621:x1875634047518592:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 534us (1214us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788744345.398338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 234 00000040:00080000:2.0:1788744345.402214:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744345.402224:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744345.404273:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788744345.404290:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788744345.405909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744345.406013:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047518848 00000100:00100000:2.0:1788744345.406023:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047518848 00000040:00080000:0.0:1788744345.407904:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788744345.407914:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788744345.407972:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788744345.407978:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788744345.408003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:2.0:1788744345.408020:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+28:11621:x1875634047518848:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788744345.408265:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+29:11621:x1875634047518848:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 250us (2364us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788744345.408348:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 64 00000100:00100000:0.0:1788744345.620286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744345.620325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519104 00000100:00100000:0.0:1788744345.620335:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519104 00000100:00100000:0.0:1788744345.620386:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 235 00000100:00100000:0.0:1788744345.620396:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+29:11634:x1875634047519104:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744345.620432:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744345.620455:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b955dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761510 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.620603:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b955e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.620621:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b955e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.620633:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b955e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744345.620647:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788744345.622585:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77800/0x7cd2bfd5e1b955dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761510 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.622611:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b955e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761510 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744345.622620:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:0.0:1788744345.622624:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788744345.622628:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76a00, rc 0) 00000100:00100000:0.0:1788744345.624412:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03c88f08-96bd-4666-9af8-74d11f561443+31:11634:x1875634047519104:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 4008us (4126us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788744345.624434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 235 00000100:00100000:2.0:1788744345.631532:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631636:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631701:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068474368:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631731:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631761:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788744345.631767:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631788:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631806:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b0097e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068474496:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631827:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631879:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068474240:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631903:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631921:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744345.631927:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068474112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.631948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744345.631977:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068473856 00000100:00100000:2.0:1788744345.631985:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068473856 00000100:00100000:2.0:1788744345.632028:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788744345.632036:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632079:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068473856:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.632085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788744345.632115:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474368 00000100:00100000:2.0:1788744345.632118:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474368 00000100:00100000:2.0:1788744345.632147:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068473984 00000100:00100000:2.0:1788744345.632150:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068473984 00000100:00100000:2.0:1788744345.632165:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474112 00000100:00100000:2.0:1788744345.632167:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474112 00000100:00100000:2.0:1788744345.632180:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788744345.632186:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068474368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632215:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068474368:12345-0@lo:400:kworker.0 Request processed in 30us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.632220:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788744345.632231:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788744345.632235:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632254:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8175880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068473984:12345-0@lo:400:kworker.0 Request processed in 19us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.632268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788744345.632279:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788744345.632284:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632314:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068474112:12345-0@lo:400:kworker.0 Request processed in 30us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.632319:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788744345.632358:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068474112:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632387:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068473984:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632395:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068473856:0@lo:400:kworker.0 00000100:00100000:2.0:1788744345.632403:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068474368:0@lo:400:kworker.0 00000100:00100000:0.0:1788744345.633297:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474496 00000100:00100000:0.0:1788744345.633306:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474496 00000100:00100000:0.0:1788744345.633348:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474240 00000100:00100000:0.0:1788744345.633350:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474240 00000100:00100000:0.0:1788744345.633371:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788744345.633378:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744345.633453:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8174700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068474496:12345-0@lo:400:kworker.0 Request processed in 76us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744345.633460:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788744345.633474:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788744345.633479:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068474240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744345.633506:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068474240:12345-0@lo:400:kworker.0 Request processed in 28us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744345.633511:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788744345.633543:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744345.633568:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744345.633599:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068474240:0@lo:400:kworker.0 00000100:00100000:0.0:1788744345.633728:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788744345.633734:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788744345.633748:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940b00b73800, transno 4294967310 00000100:00100000:0.0:1788744345.633760:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b0097e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068474496:0@lo:400:kworker.0 00000100:00100000:1.0:1788744345.635956:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744345.636025:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519232 00000100:00100000:3.0:1788744345.636047:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519232 00000100:00100000:3.0:1788744345.636111:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 236 00000100:00100000:3.0:1788744345.636123:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:11634:x1875634047519232:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:3.0:1788744345.636196:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636215:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636228:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636258:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636266:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636273:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636279:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744345.636283:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636290:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636301:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:3.0:1788744345.636304:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788744345.636309:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744345.636324:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744345.636388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03c88f08-96bd-4666-9af8-74d11f561443+31:11634:x1875634047519232:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 268us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744345.636395:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 236 00000100:00100000:2.0:1788744345.639205:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744345.639233:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744345.639299:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744345.639584:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474624 00000100:00100000:3.0:1788744345.639594:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474624 00000100:00100000:3.0:1788744345.639652:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744345.639662:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068474624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744345.639700:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744345.639746:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068474624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744345.639753:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788744345.639994:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068474624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744345.729912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744345.735986:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519360 00000100:00100000:1.0:1788744345.736002:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519360 00000100:00100000:2.0:1788744345.738312:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:2.0:1788744345.738325:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+7:2352:x1875634047519360:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:2.0:1788744345.738346:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744345.738370:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b955f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761517 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744345.738399:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e1297, atime: 0x6a9e1296, ctime: 0x6a9e1297, blocks: 0xb 00010000:00010000:2.0:1788744345.738430:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=417s v=(0 0) 00010000:00010000:2.0:1788744345.738435:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744345.738465:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b955f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761517 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744345.738484:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b955f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761517 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744345.738498:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388600, rc 0) 00000100:00100000:2.0:1788744345.738581:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+8:2352:x1875634047519360:12345-192.168.204.56@tcp:101:cat.0 Request processed in 258us (8683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744345.738589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 72 00000100:00100000:3.0:1788744345.743054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744345.743219:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519488 00000100:00100000:1.0:1788744345.743232:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519488 00002000:00100000:1.0:1788744345.743289:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff940afa5dc000 x1875634047519488/t0(0) o3->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:621/0 lens 488/0 e 0 to 0 dl 1788744356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744345.743301:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa5dc000 with x1875634047519488 ext(0->4095) 00002000:00010000:1.0:1788744345.743308:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940afa5dc000 00000100:00100000:1.0:1788744345.743344:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:1.0:1788744345.743353:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047519488:12345-192.168.204.56@tcp:3:cat.0 00000100:00100000:1.0:1788744345.743618:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047519488:12345-192.168.204.56@tcp:3:cat.0 Request processed in 264us (576us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788744345.743627:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00002000:00100000:1.0:1788744345.743634:0:6687:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff940afa5dc000 x1875634047519488/t0(0) o3->03c88f08-96bd-4666-9af8-74d11f561443@192.168.204.56@tcp:621/0 lens 488/4536 e 0 to 0 dl 1788744356 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788744345.743642:0:6687:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff940afa5dc000 with x1875634047519488 ext(0->4095) 00002000:00010000:1.0:1788744345.743661:0:6687:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff940afa5dc000 00010000:00010000:0.0:1788744346.333157:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744346.462722:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744346.462735:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744346.462770:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788744346.462779:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788744346.653035:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744346.653057:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068474752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744346.653123:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744346.653192:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474752 00000100:00100000:0.0:1788744346.653199:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474752 00000100:00100000:0.0:1788744346.653256:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788744346.653266:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634068474752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744346.653303:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744346.653347:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875634068474752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744346.653376:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788744346.653410:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744346.653450:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068474752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744347.134995:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744347.135036:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744347.135061:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744347.135083:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744347.135110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744347.135146:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519616 00000100:00100000:0.0:1788744347.135159:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519616 00000100:00100000:0.0:1788744347.135218:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 308 00000100:00100000:0.0:1788744347.135230:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047519616:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744347.135311:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047519616:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 82us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744347.135320:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 308 00000100:00100000:0.0:1788744347.135358:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519872 00000100:00100000:0.0:1788744347.135362:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519872 00000100:00100000:0.0:1788744347.135422:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520000 00000100:00100000:0.0:1788744347.135426:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520000 00000100:00100000:0.0:1788744347.135449:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 89 00000100:00100000:0.0:1788744347.135456:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047519872:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744347.135486:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+8:2354:x1875634047519872:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744347.135493:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 89 00000100:00100000:0.0:1788744347.135515:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 90 00000100:00100000:0.0:1788744347.135522:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047520000:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744347.135587:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047520000:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 66us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744347.135595:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 90 00000100:00100000:0.0:1788744347.135619:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520128 00000100:00100000:0.0:1788744347.135622:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520128 00000100:00100000:0.0:1788744347.135648:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047519744 00000100:00100000:0.0:1788744347.135650:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047519744 00000100:00100000:0.0:1788744347.135673:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:0.0:1788744347.135680:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047520128:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744347.135710:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047520128:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 32us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744347.135717:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 179 00000100:00100000:0.0:1788744347.135730:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 180 00000100:00100000:0.0:1788744347.135737:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+31:2354:x1875634047519744:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744347.135778:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+31:2354:x1875634047519744:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 41us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744347.135784:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 180 00000100:00080000:1.0:1788744347.135796:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788744347.135803:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788744347.135806:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788744347.361075:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744348.379107:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744349.281051:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788744349.281065:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788744349.281089:0:5858:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff940ad31cc9c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788744349.281095:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff940ad31cc480 00000020:00080000:1.0:1788744349.281099:0:5858:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff940affd71900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff940affde9c00 00000020:00080000:1.0:1788744349.281131:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788744349.281373:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1788744349.403365:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744349.820586:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788744349.820602:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788744349.820608:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00010000:00010000:0.0:1788744350.426660:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744350.754584:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744350.754611:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068474880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744350.754686:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744350.754765:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068474880 00000100:00100000:3.0:1788744350.754775:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068474880 00000100:00100000:3.0:1788744350.754851:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788744350.754863:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068474880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744350.754913:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744350.754966:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068474880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744350.754990:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788744350.754998:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788744350.755139:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744350.755145:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068475008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.755194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744350.755238:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475008 00000100:00100000:0.0:1788744350.755242:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475008 00000100:00100000:0.0:1788744350.755274:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788744350.755281:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068475008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.755346:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3312:x1875634068475008:12345-0@lo:400:kworker.0 Request processed in 65us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744350.755353:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788744350.755402:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068475008:0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.755454:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068475136:0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.755492:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744350.755797:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475136 00000100:00100000:0.0:1788744350.755802:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475136 00000100:00100000:3.0:1788744350.756605:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068474880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744350.756681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788744350.756691:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068475136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.756952:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068475136:12345-0@lo:400:kworker.0 Request processed in 262us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744350.756960:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788744350.757398:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068475392:0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.757443:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744350.757483:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475392 00000100:00100000:0.0:1788744350.757488:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475392 00000100:00100000:0.0:1788744350.757529:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788744350.757955:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068475136:0@lo:400:kworker.0 00000100:00100000:3.0:1788744350.757975:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744350.757982:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068475264:0@lo:400:kworker.0 00000100:00100000:3.0:1788744350.758028:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744350.758069:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475264 00000100:00100000:3.0:1788744350.758074:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475264 00000100:00100000:3.0:1788744350.758108:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788744350.758117:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068475264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744350.758167:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068475264:12345-0@lo:400:kworker.0 Request processed in 51us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744350.758173:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:3.0:1788744350.758199:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744350.758201:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068475392:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788744350.758207:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744350.758244:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068475264:0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.758255:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0509f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068475392:12345-0@lo:400:kworker.0 Request processed in 60us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744350.758263:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788744350.758827:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788744350.758836:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff940b00b71f80, transno 4294967323 00000004:00080000:0.0:1788744350.758847:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788744350.759311:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad0c49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068475392:0@lo:400:kworker.0 00000100:00100000:2.0:1788744350.759413:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068475520:0@lo:400:kworker.0 00000100:00100000:2.0:1788744350.759459:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744350.759524:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475520 00000100:00100000:0.0:1788744350.759538:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475520 00000100:00100000:0.0:1788744350.759599:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788744350.759606:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068475520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744350.759943:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068475520:12345-0@lo:400:kworker.0 Request processed in 336us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744350.759951:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788744350.760204:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068475520:0@lo:400:kworker.0 00000100:00080000:2.0:1788744350.760660:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744351.213170:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744351.213752:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520256 00000100:00100000:3.0:1788744351.213764:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520256 00000100:00100000:3.0:1788744351.213894:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 237 00000100:00100000:3.0:1788744351.213906:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+18:11287:x1875634047520256:12345-192.168.204.56@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788744351.214246:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744351.214400:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03c88f08-96bd-4666-9af8-74d11f561443+18:11287:x1875634047520256:12345-192.168.204.56@tcp:60:lhsmtool_posix.0 Request processed in 495us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744351.214408:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 237 00000100:00100000:2.0:1788744351.217986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744351.218350:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520512 00000100:00100000:3.0:1788744351.218382:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520512 00000100:00100000:3.0:1788744351.218656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 65 00000100:00100000:3.0:1788744351.218670:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+18:11287:x1875634047520512:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788744351.219252:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+19:11287:x1875634047520512:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 584us (1275us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788744351.219261:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 65 00010000:00010000:2.0:1788744351.451068:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744351.771748:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068475648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744351.771826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744351.772276:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475648 00000100:00100000:0.0:1788744351.772288:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475648 00000100:00100000:0.0:1788744351.772364:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788744351.772375:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068475648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744351.772678:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744351.772740:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068475648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 366us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744351.772747:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788744351.772775:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068475648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744352.232705:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744352.232768:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744352.232809:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744352.232845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744352.232886:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047521024 00000100:00100000:1.0:1788744352.232892:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744352.232897:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047521024 00000100:00100000:1.0:1788744352.232917:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520896 00000100:00100000:1.0:1788744352.232921:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520896 00000100:00100000:2.0:1788744352.232996:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520768 00000100:00100000:2.0:1788744352.233000:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520768 00000100:00100000:2.0:1788744352.233033:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047521152 00000100:00100000:2.0:1788744352.233036:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047521152 00000100:00100000:2.0:1788744352.233059:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 184 00000100:00100000:2.0:1788744352.233079:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+19:2354:x1875634047520768:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744352.233171:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03c88f08-96bd-4666-9af8-74d11f561443+19:2354:x1875634047520768:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 93us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744352.233179:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 184 00000100:00100000:2.0:1788744352.233198:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 185 00000100:00100000:2.0:1788744352.233205:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047521152:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744352.233229:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2354:x1875634047521152:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744352.233235:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 185 00000100:00080000:2.0:1788744352.233252:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744352.233256:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744352.233257:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744352.233433:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:1.0:1788744352.233443:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047520896:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744352.233483:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+7:2354:x1875634047520896:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 43us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744352.233496:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:1.0:1788744352.233511:0:8624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:1.0:1788744352.233516:0:8624:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047521024:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744352.233543:0:8624:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03c88f08-96bd-4666-9af8-74d11f561443+5:2354:x1875634047521024:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 26us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744352.233583:0:8624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:3.0:1788744352.233643:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047520640 00000100:00100000:3.0:1788744352.233648:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047520640 00000100:00100000:3.0:1788744352.233679:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 310 00000100:00100000:3.0:1788744352.233686:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047520640:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744352.233712:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047520640:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744352.233718:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 310 00010000:00010000:0.0:1788744352.474735:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744353.248652:0:12714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:25:51 (1788744351) 00010000:00010000:2.0:1788744353.512185:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788744354.415179:0:5858:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1788744354.415213:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788744354.415232:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788744354.415261:0:5869:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788744354.524148:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744355.548670:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744355.646948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744355.647125:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047521280 00000100:00100000:3.0:1788744355.647136:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047521280 00000100:00100000:3.0:1788744355.647220:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 238 00000100:00100000:3.0:1788744355.647252:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:12299:x1875634047521280:12345-192.168.204.56@tcp:101:lsof.0 00010000:00010000:3.0:1788744355.647274:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744355.647296:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576151e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647363:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647378:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647404:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744355.647446:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744355.647450:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744355.647493:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647669:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc400/0x7cd2bfd5e1b955ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576151e expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647687:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576151e expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744355.647695:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:3.0:1788744355.647698:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744355.647701:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc200, rc 0) 00000100:00100000:3.0:1788744355.647764:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:12299:x1875634047521280:12345-192.168.204.56@tcp:101:lsof.0 Request processed in 514us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744355.647772:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 238 00000100:00080000:2.0:1788744355.649539:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744355.866850:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068476032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.866917:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744355.866984:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788744355.866992:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068475904:0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.867019:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744355.867039:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068476416:0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.867069:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744355.867071:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476032 00000100:00100000:2.0:1788744355.867082:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476032 00000100:00100000:2.0:1788744355.867141:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475904 00000100:00100000:0.0:1788744355.867142:0:11969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476416 00000100:00100000:2.0:1788744355.867145:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475904 00000100:00100000:0.0:1788744355.867149:0:11969:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476416 00000100:00100000:2.0:1788744355.867173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788744355.867185:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068476032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.867192:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788744355.867203:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068476416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744355.867272:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068476032:12345-0@lo:400:kworker.0 Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744355.867275:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068476416:12345-0@lo:400:kworker.0 Request processed in 73us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744355.867285:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788744355.867297:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788744355.867319:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788744355.867328:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068475904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.867361:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068476416:0@lo:400:kworker.0 00000100:00100000:2.0:1788744355.867367:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875634068475904:12345-0@lo:400:kworker.0 Request processed in 39us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744355.867375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:2.0:1788744355.867394:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744355.867399:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744355.867506:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068476032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.867527:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875634068475904:0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.868770:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068476160:0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.868831:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744355.868868:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788744355.868875:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068475776:0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.868902:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744355.868935:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068476288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.868966:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744355.868997:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068475776 00000100:00100000:1.0:1788744355.869004:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068475776 00000100:00100000:1.0:1788744355.869041:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788744355.869050:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068475776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.869104:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3310:x1875634068475776:12345-0@lo:400:kworker.0 Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744355.869111:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788744355.869154:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068475776:0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.869248:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476160 00000100:00100000:0.0:1788744355.869253:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476160 00000100:00100000:0.0:1788744355.869299:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788744355.869306:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068476160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744355.869345:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068476160:12345-0@lo:400:kworker.0 Request processed in 40us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744355.869352:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788744355.869896:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788744355.869935:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068476160:0@lo:400:kworker.0 00000100:00100000:2.0:1788744355.872993:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744355.873020:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068476544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744355.873026:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476288 00000100:00100000:0.0:1788744355.873038:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476288 00000100:00100000:0.0:1788744355.873113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788744355.873124:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068476288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744355.873347:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744355.873404:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875634068476288:12345-0@lo:400:kworker.0 Request processed in 280us (4435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744355.873419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788744355.889538:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476544 00000100:00100000:1.0:1788744355.889589:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476544 00000100:00080000:0.0:1788744355.889650:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744355.889717:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875634068476288:0@lo:400:kworker.0 00000100:00100000:1.0:1788744355.891800:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788744355.891813:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068476544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744355.891857:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744355.891945:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068476544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (18598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744355.891952:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788744355.892122:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ae5d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068476544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788744356.571137:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744356.698908:0:11681:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788744356.698922:0:11681:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788744356.699897:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788744356.699907:0:11681:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788744356.890830:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744356.890857:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068476672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744356.890940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744356.891081:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476672 00000100:00100000:0.0:1788744356.891090:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476672 00000100:00100000:0.0:1788744356.891143:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788744356.891154:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068476672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744356.891191:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744356.891259:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068476672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744356.891267:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788744356.891351:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068476672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744357.017160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744357.018086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047521536 00000100:00100000:1.0:1788744357.018099:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047521536 00000100:00100000:1.0:1788744357.018192:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:1.0:1788744357.018216:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+18:12300:x1875634047521536:12345-192.168.204.56@tcp:35:umount.0 00000100:00080000:0.0:1788744357.019581:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744357.021305:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03c88f08-96bd-4666-9af8-74d11f561443+19:12300:x1875634047521536:12345-192.168.204.56@tcp:35:umount.0 Request processed in 3090us (4141us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788744357.021320:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 66 00000100:00100000:0.0:1788744357.026490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744357.027338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047521792 00000100:00100000:2.0:1788744357.027351:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047521792 00000100:00100000:2.0:1788744357.027780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 67 00000100:00100000:2.0:1788744357.027794:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+19:12300:x1875634047521792:12345-192.168.204.56@tcp:35:umount.0 00000100:00100000:2.0:1788744357.028186:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c3764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:12300:x1875634047521792:12345-192.168.204.56@tcp:35:umount.0 Request processed in 395us (1707us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788744357.028195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 67 00000100:00100000:2.0:1788744357.042813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744357.042926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522048 00000100:00100000:0.0:1788744357.042939:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522048 00000100:00100000:0.0:1788744357.043009:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 68 00000100:00100000:0.0:1788744357.043021:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad8697450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+20:12300:x1875634047522048:12345-192.168.204.56@tcp:35:umount.0 00000100:00100000:0.0:1788744357.043349:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad8697450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+21:12300:x1875634047522048:12345-192.168.204.56@tcp:35:umount.0 Request processed in 330us (550us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788744357.043367:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 68 00000100:00100000:3.0:1788744357.050921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744357.051118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522304 00000100:00100000:2.0:1788744357.051135:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522304 00000100:00100000:2.0:1788744357.051207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:2.0:1788744357.051220:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+21:12300:x1875634047522304:12345-192.168.204.56@tcp:35:umount.0 00000100:00100000:2.0:1788744357.051640:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03c88f08-96bd-4666-9af8-74d11f561443+22:12300:x1875634047522304:12345-192.168.204.56@tcp:35:umount.0 Request processed in 423us (730us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788744357.051649:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 69 00000100:00100000:2.0:1788744357.058924:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744357.058964:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744357.059009:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744357.059115:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522432 00000100:00100000:0.0:1788744357.059127:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522432 00000100:00100000:0.0:1788744357.059193:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522560 00000100:00100000:0.0:1788744357.059207:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522560 00000100:00100000:0.0:1788744357.059235:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:0.0:1788744357.059245:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+14:2354:x1875634047522432:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744357.059264:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744357.059288:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9468c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b0 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744357.059340:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744357.059410:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+13:2354:x1875634047522432:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 165us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744357.059417:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:0.0:1788744357.059436:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:0.0:1788744357.059441:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2354:x1875634047522560:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744357.059447:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744357.059456:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7297c00/0x7cd2bfd5e1b945f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761078 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744357.059465:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744357.059480:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2354:x1875634047522560:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 39us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744357.059485:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:3.0:1788744357.060056:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522688 00000100:00100000:3.0:1788744357.060064:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522688 00000100:00100000:3.0:1788744357.060115:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 73 00000100:00100000:3.0:1788744357.060125:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+5:2350:x1875634047522688:12345-192.168.204.56@tcp:9:umount.0 00000020:00000080:3.0:1788744357.060152:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94964 00000100:00080000:3.0:1788744357.060162:0:6681:0:(import.c:65:import_set_state_nolock()) ffff940ac2d38800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744357.060215:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788744357.060512:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03c88f08-96bd-4666-9af8-74d11f561443+2:2350:x1875634047522688:12345-192.168.204.56@tcp:9:umount.0 Request processed in 388us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744357.060519:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 73 00010000:00010000:3.0:1788744357.060733:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744357.061784:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744357.061862:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047522816 00000100:00100000:1.0:1788744357.061870:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047522816 00000100:00100000:1.0:1788744357.061919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744357.061928:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2353:x1875634047522816:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744357.061940:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744357.061957:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b948a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576117b expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.061972:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744357.062019:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047522816:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744357.062038:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00080000:0.0:1788744357.062470:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744357.070186:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744357.070278:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047523200 00000100:00100000:0.0:1788744357.070292:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047523200 00000100:00100000:0.0:1788744357.070395:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 74 00000100:00100000:0.0:1788744357.070407:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+7:2350:x1875634047523200:12345-192.168.204.56@tcp:9:umount.0 00000020:00000080:0.0:1788744357.070444:0:6682:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94bc5 00000020:00010000:0.0:1788744357.070453:0:6682:0:(genops.c:1920:obd_stale_export_put()) Put export ffff940ad2c6e000: total 0 00000100:00080000:0.0:1788744357.070457:0:6682:0:(import.c:65:import_set_state_nolock()) ffff940ad2c6f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788744357.070504:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788744357.070815:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03c88f08-96bd-4666-9af8-74d11f561443+5:2350:x1875634047523200:12345-192.168.204.56@tcp:9:umount.0 Request processed in 409us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744357.070839:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 74 00000020:00010000:3.0:1788744357.071532:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff940ad2c6e000: total 0 00010000:00010000:3.0:1788744357.071607:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff940ad2c6e000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788744357.071673:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b94f68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761350 expref: 4 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744357.071721:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b955f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761517 expref: 3 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744357.071740:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff940ad2c6e000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788744357.071754:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744357.071757:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744357.071759:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744357.071880:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744357.080848:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744357.081169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524224 00000100:00100000:3.0:1788744357.081181:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524224 00000100:00100000:3.0:1788744357.081265:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 239 00000100:00100000:3.0:1788744357.081276:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+22:2350:x1875634047524224:12345-192.168.204.56@tcp:39:umount.0 00000020:00000080:3.0:1788744357.081330:0:5837:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94600 00000020:00010000:3.0:1788744357.081349:0:5837:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9409c2131800: total 0 00000100:00080000:3.0:1788744357.081353:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9409c2131000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788744357.081392:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788744357.081817:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03c88f08-96bd-4666-9af8-74d11f561443+21:2350:x1875634047524224:12345-192.168.204.56@tcp:39:umount.0 Request processed in 542us (980us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788744357.081826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 239 00000020:00010000:1.0:1788744357.082000:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9409c2131800: total 0 00010000:00010000:1.0:1788744357.082005:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744357.082052:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9409c2131800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788744357.082095:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:1.0:1788744357.082099:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788744357.082107:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389a00/0x7cd2bfd5e1b9493a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57611a5 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082125:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:1.0:1788744357.082127:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744357.082131:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389c00/0x7cd2bfd5e1b94fbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761365 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082142:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff940ac2bbcc00) 00010000:00010000:1.0:1788744357.082144:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744357.082148:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389000/0x7cd2bfd5e1b94c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761277 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082162:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744357.082164:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744357.082168:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7297200/0x7cd2bfd5e1b94e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761303 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082181:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744357.082183:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744357.082209:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2a00/0x7cd2bfd5e1b955b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761502 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082225:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744357.082228:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788744357.082232:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3a00/0x7cd2bfd5e1b952b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576143e expref: 15 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082244:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744357.082247:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744357.082250:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b955e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761510 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082263:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ac2bbcf00) 00010000:00010000:1.0:1788744357.082265:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744357.082268:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7388a00/0x7cd2bfd5e1b948e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761190 expref: 13 pid: 10823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082282:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744357.082284:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744357.082288:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7389400/0x7cd2bfd5e1b94f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576133b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082299:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff940ac2bbc800) 00010000:00010000:1.0:1788744357.082301:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744357.082304:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fce00/0x7cd2bfd5e1b954d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57614ca expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082319:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff940ad90af900) 00010000:00010000:1.0:1788744357.082327:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788744357.082331:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af7296800/0x7cd2bfd5e1b94fd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576136c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082366:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ac3570c00) 00010000:00010000:1.0:1788744357.082369:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788744357.082373:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b948ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761189 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082388:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff940ad90afa00) 00010000:00010000:1.0:1788744357.082391:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788744357.082394:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac0030400/0x7cd2bfd5e1b94f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761349 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744357.082407:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9409c2131800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788744357.082420:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744357.082423:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744357.082424:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744357.355748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744357.355812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744357.355921:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524352 00000100:00100000:3.0:1788744357.355936:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524352 00000100:00100000:3.0:1788744357.356008:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 312 00000100:00100000:3.0:1788744357.356020:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047524352:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744357.356107:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2352:x1875634047524352:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744357.356116:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 312 00000100:00100000:0.0:1788744357.356494:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524480 00000100:00100000:0.0:1788744357.356500:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524480 00000100:00100000:0.0:1788744357.356601:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 189 00000100:00100000:0.0:1788744357.356611:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2352:x1875634047524480:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744357.356646:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ae5d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2352:x1875634047524480:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 38us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744357.356652:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 189 00000100:00080000:1.0:1788744357.356743:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744357.594852:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744358.618753:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744359.078914:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744359.078963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744359.079008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744359.079128:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524608 00000100:00100000:0.0:1788744359.079144:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524608 00000100:00100000:0.0:1788744359.079238:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524864 00000100:00100000:0.0:1788744359.079242:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524864 00000100:00100000:0.0:1788744359.079254:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047524736 00000100:00100000:0.0:1788744359.079257:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047524736 00000100:00100000:0.0:1788744359.079277:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:0.0:1788744359.079288:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2353:x1875634047524608:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744359.079308:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788744359.079478:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744359.079488:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+12:2353:x1875634047524864:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744359.079497:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744359.079521:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b94899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761174 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744359.079543:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744359.079684:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+11:2353:x1875634047524864:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 197us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.079693:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744359.079734:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:2.0:1788744359.079740:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+10:2353:x1875634047524736:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744359.079749:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744359.079759:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389200/0x7cd2bfd5e1b946d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610ef expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744359.079770:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744359.079789:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5ce62f61-9f0c-4e8b-869e-d738743a7119+9:2353:x1875634047524736:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 49us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744359.079797:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 22 00010000:00010000:0.0:1788744359.080134:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fda00/0x7cd2bfd5e1b946d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610c5 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744359.080147:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744359.080191:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa485880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5ce62f61-9f0c-4e8b-869e-d738743a7119+7:2353:x1875634047524608:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 905us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744359.080197:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744359.096422:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744359.096546:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525120 00000100:00100000:1.0:1788744359.096592:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525120 00000100:00100000:1.0:1788744359.096686:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 240 00000100:00100000:1.0:1788744359.096700:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+6:2350:x1875634047525120:12345-192.168.204.56@tcp:39:umount.0 00000020:00000080:1.0:1788744359.096762:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b946e7 00000020:00010000:1.0:1788744359.096774:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff940af78a7000: total 0 00000100:00080000:1.0:1788744359.096780:0:5838:0:(import.c:65:import_set_state_nolock()) ffff940af78a3000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744359.096820:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788744359.097075:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c98c4d6-e812-4ea8-bad5-ea714521aba0+5:2350:x1875634047525120:12345-192.168.204.56@tcp:39:umount.0 Request processed in 378us (669us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788744359.097093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 240 00000100:00080000:0.0:1788744359.097877:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1788744359.097946:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff940af78a7000: total 0 00010000:00010000:2.0:1788744359.098003:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff940af78a7000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788744359.098044:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ac2bbc400) 00010000:00010000:2.0:1788744359.098049:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744359.098059:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac13fc200/0x7cd2bfd5e1b95606 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576151e expref: 4 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744359.098088:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff940af78a7000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788744359.098100:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744359.098102:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744359.098104:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744359.172422:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744359.176984:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525376 00000100:00100000:3.0:1788744359.177001:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525376 00000100:00100000:3.0:1788744359.177907:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 313 00000100:00100000:3.0:1788744359.177929:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+7:2350:x1875634047525376:12345-192.168.204.56@tcp:251:umount.0 00000020:00000080:3.0:1788744359.177993:0:5828:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b945dd 00000020:00010000:3.0:1788744359.178001:0:5828:0:(genops.c:1920:obd_stale_export_put()) Put export ffff940b004f6800: total 0 00000100:00080000:3.0:1788744359.178006:0:5828:0:(import.c:65:import_set_state_nolock()) ffff940b004f6000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788744359.178541:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5ce62f61-9f0c-4e8b-869e-d738743a7119+3:2350:x1875634047525376:12345-192.168.204.56@tcp:251:umount.0 Request processed in 618us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744359.178580:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 313 00000020:00010000:1.0:1788744359.180405:0:5824:0:(genops.c:1906:obd_stale_export_get()) Get export ffff940b004f6800: total 0 00010000:00010000:1.0:1788744359.180425:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744359.180500:0:5824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff940b004f6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788744359.180535:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fc000/0x7cd2bfd5e1b94693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57610b7 expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744359.180584:0:5824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff940b004f6800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788744359.180590:0:5824:0:(genops.c:885:class_export_put()) final put ffff940b004f6800/5ce62f61-9f0c-4e8b-869e-d738743a7119 00010000:00010000:1.0:1788744359.180598:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744359.180600:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744359.180601:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744359.184432:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940b004f6800/5ce62f61-9f0c-4e8b-869e-d738743a7119 for MGS 00000020:00000080:0.0:1788744359.184512:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940b004f6000 for MGS 00000001:00080000:0.0:1788744359.507906:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1788744359.507925:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000001:00080000:0.0:1788744359.507999:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788744359.508002:0:5858:0:(genops.c:885:class_export_put()) final put ffff940af78a7000/9c98c4d6-e812-4ea8-bad5-ea714521aba0 00000001:00080000:0.0:1788744359.508034:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1788744359.508051:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000001:00080000:0.0:1788744359.508057:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788744359.508060:0:5858:0:(genops.c:885:class_export_put()) final put ffff9409c2131800/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:1.0:1788744359.508200:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78a7000/9c98c4d6-e812-4ea8-bad5-ea714521aba0 for lustre-MDT0000 00000020:00000080:1.0:1788744359.508268:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff9409c2131800/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-MDT0000 00000020:00000080:1.0:1788744359.508301:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af78a3000 for lustre-MDT0000 00000020:00000080:1.0:1788744359.508307:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9409c2131000 for lustre-MDT0000 00010000:00010000:1.0:1788744359.643687:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788744360.106296:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:0.0:1788744360.106309:0:6708:0:(genops.c:885:class_export_put()) final put ffff940ad2c6e000/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:3.0:1788744360.106496:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2c6e000/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-OST0000 00000020:00000080:3.0:1788744360.106603:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ad2c6f000 for lustre-OST0000 00000001:00100000:2.0:1788744360.567416:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:2.0:1788744360.567425:0:7639:0:(genops.c:885:class_export_put()) final put ffff940ac2d3f800/03c88f08-96bd-4666-9af8-74d11f561443 00000020:00000080:3.0:1788744360.567507:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ac2d3f800/03c88f08-96bd-4666-9af8-74d11f561443 for lustre-OST0001 00000020:00000080:3.0:1788744360.567594:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ac2d38800 for lustre-OST0001 00010000:00010000:0.0:1788744360.671066:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744360.823147:0:12914:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788744360.850122:0:12914:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788744360.850192:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.850209:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.850290:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.850299:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.850318:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744360.850328:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788744360.850356:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744360.850360:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744360.850367:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788744360.850544:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744360.850634:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.850662:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fd400 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744360.850666:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.850674:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744360.850682:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744360.850688:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744360.850690:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788744360.850693:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788744360.850734:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.850741:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788744360.850805:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068476800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744360.850889:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744360.850972:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.850980:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fd400/0x7cd2bfd5e1b94662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94669 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.850998:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744360.851000:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744360.851002:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744360.851021:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476800 00000100:00100000:2.0:1788744360.851031:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476800 00000100:00100000:2.0:1788744360.851092:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744360.851102:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3311:x1875634068476800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744360.851135:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744360.851150:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7296400/0x7cd2bfd5e1b94669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94662 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.851163:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788744360.851294:0:12914:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788744360.851323:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068476928:0@lo:39:umount.0 00000100:00100000:0.0:1788744360.851359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744360.851395:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068476928 00000100:00100000:0.0:1788744360.851399:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068476928 00000100:00100000:0.0:1788744360.851443:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788744360.851451:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634068476928:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788744360.851480:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b943ec 00000100:00080000:0.0:1788744360.851488:0:5836:0:(import.c:65:import_set_state_nolock()) ffff940af6e46800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788744360.851541:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b0097ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875634068476928:12345-0@lo:39:umount.0 Request processed in 91us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744360.851562:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1788744360.851572:0:5836:0:(genops.c:885:class_export_put()) final put ffff940af6e47000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788744360.851596:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744360.851621:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788744360.851626:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068476928:0@lo:39:umount.0 00000100:00080000:0.0:1788744360.851646:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744360.851649:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744360.851653:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788744360.852600:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852614:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852621:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852627:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852663:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744360.852670:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852677:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852683:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852690:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852703:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744360.852718:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744360.852724:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852731:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744360.852735:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852743:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744360.852750:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744360.852755:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744360.852763:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788744360.852790:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852796:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744360.852818:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852825:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7296600/0x7cd2bfd5e1b94670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94677 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852839:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744360.852843:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852848:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744360.852851:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852858:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744360.852864:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744360.852870:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744360.852872:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788744360.852874:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788744360.852888:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852894:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744360.852909:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852915:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0030000/0x7cd2bfd5e1b94597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9459e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.852928:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744360.852929:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744360.852931:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744360.852946:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068477184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744360.853007:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744360.853054:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788744360.853060:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068477056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744360.853082:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788744360.853114:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853123:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853141:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853148:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853160:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744360.853168:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744360.853172:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853188:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744360.853191:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853198:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744360.853204:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744360.853210:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788744360.853213:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788744360.853215:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788744360.853230:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.853236:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788744360.853538:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477184 00000100:00100000:1.0:1788744360.853546:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477184 00000100:00100000:1.0:1788744360.853609:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477056 00000100:00100000:1.0:1788744360.853612:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477056 00000100:00100000:1.0:1788744360.853628:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744360.853636:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+20:3313:x1875634068477184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744360.853649:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744360.853663:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29ca000/0x7cd2bfd5e1b9459e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94597 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744360.853677:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744360.853725:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+19:3313:x1875634068477184:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744360.853732:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744360.853748:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744360.853754:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+18:3313:x1875634068477056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744360.853761:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744360.853770:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164e200/0x7cd2bfd5e1b94677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94670 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744360.853781:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744360.853802:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+17:3313:x1875634068477056:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744360.853808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788744360.853861:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9409c3764380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068477056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744360.853870:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3313:1875634068477184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744360.855198:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3311:x1875634068476800:12345-0@lo:103:ldlm_bl.0 Request processed in 4091us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744360.855210:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744360.855260:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068477312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744360.855313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744360.855372:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477312 00000100:00100000:2.0:1788744360.855379:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477312 00000100:00100000:2.0:1788744360.855416:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788744360.855795:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad1d78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+16:3310:x1875634068477312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744360.855811:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744360.855831:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7296a00/0x7cd2bfd5e1b94892 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9488b expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744360.855845:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744360.855925:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad1d78450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:3310:x1875634068477312:12345-0@lo:103:ldlm_bl.0 Request processed in 502us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744360.855932:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000020:00000080:2.0:1788744360.855989:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af6e47000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788744360.856062:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af6e46800 for lustre-MDT0000 00010000:00010000:2.0:1788744360.856084:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744360.857737:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.857755:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac0031600/0x7cd2bfd5e1b9488b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94892 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.857772:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744360.857774:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744360.857776:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744360.858847:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068477312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744360.858958:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068476800:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744360.859092:0:12914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.859105:0:12914:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.859139:0:12914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.859146:0:12914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744360.859175:0:12914:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744360.859181:0:12914:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788744360.859185:0:12914:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788744360.859233:0:12914:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788744360.859236:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788744360.859241:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744360.859248:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788744360.859253:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff940af78a7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744360.859259:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9409c1188800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744360.859263:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff940af78d3380) has exports, disconnecting them 00000020:00080000:0.0:1788744360.859268:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff940af78a7800), last request at 1788744355 00000020:00000080:0.0:1788744360.859275:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9455f 00000100:00080000:0.0:1788744360.859291:0:12914:0:(import.c:65:import_set_state_nolock()) ffff940af78a4000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788744360.859341:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff940af78a7800): rc 0 00000020:00000080:0.0:1788744360.859344:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78a7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788744360.859350:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9409c1188800), last request at 1788744355 00000020:00000080:0.0:1788744360.859353:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94486 00000100:00080000:0.0:1788744360.859358:0:12914:0:(import.c:65:import_set_state_nolock()) ffff9409c118e000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788744360.859365:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9409c1188800): rc 0 00000020:00000080:0.0:1788744360.859367:0:12914:0:(genops.c:885:class_export_put()) final put ffff9409c1188800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788744360.859376:0:12914:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbcb70224bae0 00000100:00080000:0.0:1788744360.859401:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788744360.859405:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788744360.859418:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1788744360.859586:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744360.859594:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.859602:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac164e000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:3.0:1788744360.859606:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.859614:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744360.859622:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744360.859628:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744360.859631:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788744360.859633:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788744360.859672:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.859679:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744360.859704:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.859724:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164e000/0x7cd2bfd5e1b9434b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94352 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.859740:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744360.859742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744360.859744:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744360.859751:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744360.859767:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068477440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744360.859837:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744360.859898:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477440 00000100:00100000:3.0:1788744360.859905:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477440 00000100:00100000:3.0:1788744360.859954:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744360.859964:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+15:3310:x1875634068477440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744360.859981:0:6695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744360.860001:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cb600/0x7cd2bfd5e1b94352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9434b expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744360.860018:0:6695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788744360.860054:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:3310:x1875634068477440:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744360.860061:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788744360.860090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3310:1875634068477440:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788744360.860331:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788744360.860348:0:12914:0:(import.c:65:import_set_state_nolock()) ffff940af78a2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788744360.860361:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788744360.860365:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788744360.860376:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788744360.860706:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744360.860779:0:12914:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788744360.860793:0:12914:0:(import.c:65:import_set_state_nolock()) ffff9409c2137000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788744360.860829:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff940af78d3380) has no exports 00000100:00100000:3.0:1788744360.860917:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068477568:0@lo:9:umount.0 00000100:00100000:3.0:1788744360.860963:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744360.861162:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068477696:0@lo:9:umount.0 00000100:00100000:3.0:1788744360.861187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744360.861400:0:8624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477568 00000100:00100000:0.0:1788744360.861407:0:8624:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477568 00000020:00000080:2.0:1788744360.861440:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78a7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788744360.861482:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff9409c1188800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788744360.861526:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af78a4000 for lustre-MDT0000 00000020:00000080:2.0:1788744360.861532:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9409c118e000 for lustre-MDT0000 00000100:00100000:1.0:1788744360.861655:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477696 00000100:00100000:1.0:1788744360.861660:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477696 00000100:00100000:1.0:1788744360.861701:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788744360.861711:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634068477568:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788744360.861737:0:6681:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b944d3 00000100:00080000:1.0:1788744360.861746:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9409c118f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788744360.861765:0:11969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788744360.861774:0:11969:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3309:x1875634068477696:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788744360.861787:0:11969:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b945c8 00000100:00080000:2.0:1788744360.861793:0:11969:0:(import.c:65:import_set_state_nolock()) ffff9409c2130800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788744360.861817:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788744360.862185:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1875634068477568:12345-0@lo:9:umount.0 Request processed in 476us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744360.862204:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788744360.862364:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788744360.862368:0:5832:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788744360.863093:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744360.863149:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940af78a2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788744360.863169:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788744360.863171:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744360.863175:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068477568:0@lo:9:umount.0 00010000:00010000:0.0:1788744360.865085:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788744360.865105:0:11969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788744360.865508:0:11969:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3309:x1875634068477696:12345-0@lo:9:umount.0 Request processed in 3731us (4315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744360.865521:0:11969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1788744360.865537:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9409c2137000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788744360.865578:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788744360.865581:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788744360.865584:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068477696:0@lo:9:umount.0 00000020:00080000:2.0:1788744360.872492:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff940af78d3380) has no exports 00000020:00000080:2.0:1788744360.938284:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b943a6 00000020:00000080:2.0:1788744360.938305:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78da800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788744360.938324:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788744360.938500:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78da800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788744360.938531:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744360.938542:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744360.938581:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff940af78d19c0) has no exports 00000020:00000080:3.0:1788744360.938962:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9439f 00000020:00000080:3.0:1788744360.938970:0:12914:0:(genops.c:885:class_export_put()) final put ffff940aceda0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744360.939031:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744360.939040:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788744360.939043:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78dd000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788744360.939046:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78dd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788744360.939051:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788744360.939383:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940aceda0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788744360.939443:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ac3003de0 - data ffff940afff03e58/ffff940ace353400 00000020:01000000:0.0:1788744360.939646:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ad8345060 - data ffff940ac44401b0/ffff940afb61d800 00000001:00000004:3.0:1788744360.968914:0:12914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788744360.989832:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744360.989862:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788744360.989970:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744360.990056:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478080 00000100:00100000:2.0:1788744360.990067:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478080 00000100:00100000:2.0:1788744360.990111:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788744360.990135:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875634068478080:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788744360.990143:0:6704:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788744360.990184:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875634068478080:12345-0@lo:400:kworker.0 Request processed in 47us (214us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744360.990191:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1788744360.990250:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788744360.990256:0:3311:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788744360.990404:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788744361.001829:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068477824:0@lo:400:kworker.0 00000100:00100000:1.0:1788744361.001923:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744361.001983:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744361.001992:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068477952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744361.002023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744361.002059:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477952 00000100:00100000:1.0:1788744361.002067:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477952 00000100:00100000:1.0:1788744361.002111:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788744361.002138:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875634068477952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788744361.002147:0:5838:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788744361.002189:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875634068477952:12345-0@lo:400:kworker.0 Request processed in 50us (164us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744361.002196:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1788744361.009143:0:3311:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744361.009159:0:3311:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 223 00000100:00080000:2.0:1788744361.009177:0:3311:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff940ace4e2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:0.0:1788744361.010170:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068477824 00000100:00100000:0.0:1788744361.010186:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068477824 00000100:00100000:2.0:1788744361.014175:0:3311:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73cc700 x1875634068478208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744361.014759:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788744361.014766:0:3312:0:(import.c:65:import_set_state_nolock()) ffff940aff841000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788744361.014770:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788744361.014775:0:3312:0:(import.c:65:import_set_state_nolock()) ffff940aff841000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744361.014779:0:3312:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 201 00000100:00080000:1.0:1788744361.014793:0:3312:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff940aff841000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744361.014814:0:3312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b72680 x1875634068478336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744361.014830:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068477952:0@lo:400:kworker.0 00000100:00100000:1.0:1788744361.015516:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788744361.015542:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:3312:x1875634068477824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744361.015662:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ac7f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18+14:3312:x1875634068477824:12345-0@lo:400:kworker.0 Request processed in 123us (13739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744361.015669:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788744361.015705:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068477824:0@lo:400:kworker.0 00000100:00100000:3.0:1788744361.015886:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068478208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788744361.015931:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744361.015960:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068478336:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788744361.015983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744361.016018:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478208 00000100:00100000:3.0:1788744361.016026:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478208 00000100:00100000:3.0:1788744361.016056:0:10823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478336 00000100:00100000:3.0:1788744361.016059:0:10823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478336 00000100:00100000:3.0:1788744361.016088:0:10823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788744361.016093:0:10823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1875634068478208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788744361.016112:0:10823:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788744361.016660:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875634068478080:0@lo:400:kworker.0 00000100:00100000:3.0:1788744361.029781:0:10823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad0c49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1875634068478208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 13678us (13840us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744361.029799:0:10823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788744361.029917:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788744361.029925:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875634068478336:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788744361.029951:0:6704:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788744361.030399:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3309:x1875634068478336:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 472us (14413us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788744361.030407:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1788744361.031211:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744361.031218:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744361.031223:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068478208:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1788744361.031234:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940aff841000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744361.031238:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744361.031240:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068478336:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1788744361.142052:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744361.142061:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788744361.142090:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744361.142094:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788744361.144433:0:6767:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788744361.144441:0:6767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1788744361.144463:0:6767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788744361.145645:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744361.145653:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788744361.145888:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744361.145891:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788744361.150236:0:7936:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788744361.150252:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788744361.150289:0:7936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788744361.212593:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9436e 00000020:00000080:1.0:1788744361.212606:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad0510800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744361.213833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad0510800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744361.214781:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94383 00000020:00000080:1.0:1788744361.214792:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78db000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744361.214847:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788744361.214856:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.214865:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744361.214869:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff940af78d0000) has no exports 00000020:00000080:2.0:1788744361.214931:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78db000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788744361.215048:0:12914:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788744361.215057:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b945c1 00000020:00000080:1.0:1788744361.215062:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af773f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788744361.215154:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788744361.215159:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.215166:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744361.215169:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff940ad0ceb380) has no exports 00000020:00000080:1.0:1788744361.215176:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b945ba 00000020:00000080:1.0:1788744361.215181:0:12914:0:(genops.c:885:class_export_put()) final put ffff9409c2133000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744361.215222:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af773f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788744361.215736:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788744361.215741:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788744361.215746:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788744361.215753:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744361.215756:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744361.215872:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9409c2133000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744361.215958:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.215966:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744361.215973:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b944cc 00000020:00000080:1.0:1788744361.215980:0:12914:0:(genops.c:885:class_export_put()) final put ffff940acdcb3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744361.215997:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9409c2137000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788744361.216003:0:37:0:(genops.c:885:class_export_put()) final put ffff940ace4a0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744361.216006:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ace4a0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788744361.216011:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788744361.216152:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788744361.216156:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.216162:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788744361.216165:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff940ac60a4d40) has no exports 00000020:00000080:1.0:1788744361.216169:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b944c5 00000020:00000080:1.0:1788744361.216173:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78a5000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744361.216190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940acdcb3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788744361.216738:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788744361.216743:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788744361.216747:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788744361.216751:0:12914:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788744361.216753:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788744361.216793:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744361.216886:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.216896:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744361.216923:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.216927:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744361.216931:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad0ce2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744361.216933:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad0ce2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788744361.216942:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744361.217087:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9438a 00000020:00000080:1.0:1788744361.217093:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78dd800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788744361.217116:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940af78a2800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788744361.217131:0:37:0:(genops.c:885:class_export_put()) final put ffff940acdcb5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744361.217133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940acdcb5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788744361.217138:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788744361.217263:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788744361.217277:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.217288:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744361.217291:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff940af78d4d40) has no exports 00000020:00000080:1.0:1788744361.217311:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.217315:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788744361.217319:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94391 00000020:00000080:1.0:1788744361.217324:0:12914:0:(genops.c:885:class_export_put()) final put ffff940af78db800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788744361.217440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78dd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788744361.217450:0:37:0:(genops.c:885:class_export_put()) final put ffff940ad2f12000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788744361.217452:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2f12000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788744361.217456:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788744361.217799:0:12914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940ac7f4d800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788744361.217803:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940ac7f4d800 3 00000020:01000004:1.0:1788744361.217806:0:12914:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff940ac7f4d800 from lustre-MDT0000 00000020:00000080:1.0:1788744361.217828:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.217832:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788744361.217836:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad0516800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788744361.217839:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad0516800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788744361.217848:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788744361.217887:0:12914:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788744361.217891:0:12914:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788744361.217894:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788744361.217897:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.217900:0:12914:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744361.217907:0:12914:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff940ad272e000 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744361.217913:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff940ad0d40000) has exports, disconnecting them 00000020:00080000:1.0:1788744361.217918:0:12914:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff940ad272e000), last request at 1788744105 00000020:00000080:1.0:1788744361.217937:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9432f 00000020:00010000:1.0:1788744361.217943:0:12914:0:(genops.c:1920:obd_stale_export_put()) Put export ffff940ad272e000: total 1 00000100:00080000:1.0:1788744361.217947:0:12914:0:(import.c:65:import_set_state_nolock()) ffff940ad2728800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788744361.218002:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff940ad272e000): rc 0 00000020:00080000:1.0:1788744361.218007:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff940ad0d40000) has no exports 00000100:00100000:1.0:1788744361.218080:0:5830:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff940ac6133800:5830] 2 exiting: rc = 0 00000020:00000080:2.0:1788744361.218389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af78db800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1788744361.218422:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff940ad272e000: total 0 00010000:00010000:3.0:1788744361.218467:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff940ad272e000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788744361.218498:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7297e00/0x7cd2bfd5e1b9464d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94646 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218514:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164fe00/0x7cd2bfd5e1b9465b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94654 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218525:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7297a00/0x7cd2bfd5e1b94876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9486f expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218534:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b94884 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9487d expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744361.218665:0:5828:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff940ac6132e00:5828] 0 exiting: rc = 1 00010000:00010000:3.0:1788744361.218764:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac164f600/0x7cd2bfd5e1b94685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9467e expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218777:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac13fd600/0x7cd2bfd5e1b94439 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94432 expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218791:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b94631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9462a expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218802:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389e00/0x7cd2bfd5e1b9463f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7cd2bfd5e1b94638 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744361.218813:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff940ad272e000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788744361.218829:0:5825:0:(genops.c:885:class_export_put()) final put ffff940ad272e000/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 00010000:00010000:3.0:1788744361.218881:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744361.218884:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744361.218886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788744361.218910:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad272e000/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 for MGS 00000100:00100000:0.0:1788744361.219301:0:5829:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff940ac6133400:5829] 1 exiting: rc = 0 00000020:00000080:2.0:1788744361.219307:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ad2728800 for MGS 00000100:00100000:1.0:1788744361.219374:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219384:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219390:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219399:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219416:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219422:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219427:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219433:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219440:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219446:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219452:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219458:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219463:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219469:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219475:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219480:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219486:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219493:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219499:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219505:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219511:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219516:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219523:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219529:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219535:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219541:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219547:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219570:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219576:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219581:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219588:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219594:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219600:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219605:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219611:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219616:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219622:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219628:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219633:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219647:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219652:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219658:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219664:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219670:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219675:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219681:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219687:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219692:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219698:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219703:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219709:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219715:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219720:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219726:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219731:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219736:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219741:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219750:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219756:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219762:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219771:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219776:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219782:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.219788:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788744361.220525:0:12914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788744361.220530:0:12914:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788744361.225349:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ac338c540 - data ffff940affe375e8/ffff940ace4a8c00 00000020:01000000:1.0:1788744361.225516:0:12914:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ad1984c60 - data ffff940af10f41b0/ffff940adbee0800 00000020:00000080:1.0:1788744361.234724:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94313 00000020:00000080:1.0:1788744361.234746:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad2f16000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788744361.234846:0:12914:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940ac7f4d800 from MGS, refs=2 00000020:01000004:1.0:1788744361.234850:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940ac7f4d800 2 00000020:01000004:1.0:1788744361.234854:0:12914:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff940ac7f4d800 from MGS 00000020:00000080:2.0:1788744361.234905:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2f16000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788744361.234910:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744361.234926:0:12914:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788744361.234931:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad2f14800/MGS 00000020:00000080:1.0:1788744361.234934:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2f14800/MGS for MGS 00000020:01000000:1.0:1788744361.234946:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788744361.235035:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788744361.235041:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744361.235048:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788744361.235057:0:12914:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff940ad0cf3800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788744361.235064:0:12914:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff940ad0cecd40) has exports, disconnecting them 00000020:00080000:1.0:1788744361.235070:0:12914:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff940ad0cf3800), last request at 1788744107 00000020:00000080:1.0:1788744361.235076:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b943de 00000020:00080000:1.0:1788744361.235088:0:12914:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff940ad0cf3800): rc 0 00000020:00000080:1.0:1788744361.235093:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad0cf3800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788744361.235270:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad0cf3800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788744361.239671:0:12914:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788744361.239684:0:12914:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744361.239689:0:12914:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788744361.239699:0:12914:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744361.239798:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ad0cf7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788744361.240020:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744361.240032:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788744361.240041:0:12914:0:(genops.c:885:class_export_put()) final put ffff940aceda7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788744361.240045:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940aceda7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788744361.240052:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788744361.240130:0:12914:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940ac7f4d800 1 00000020:00000080:2.0:1788744361.240138:0:12914:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94305 00000020:00000080:2.0:1788744361.240147:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ad2f15800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788744361.240191:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788744361.240196:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744361.240215:0:12914:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788744361.240220:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff940ad1cd19c0) has no exports 00000020:00000080:3.0:1788744361.240286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2f15800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788744361.312419:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744361.312436:0:12914:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788744361.312444:0:12914:0:(genops.c:885:class_export_put()) final put ffff940ac7f48000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788744361.312449:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940ac7f48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788744361.312459:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788744361.312914:0:12914:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff940ac7f49800 00000020:01000000:3.0:1788744361.312935:0:12914:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788744361.312939:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744361.312944:0:12914:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744361.312948:0:12914:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff940ad1cd0000) has no exports 00000100:00100000:0.0:1788744361.313307:0:5836:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff940ac6133000:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1788744361.313375:0:5838:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff940ac363a600:5838] 2 exiting: rc = 0 00000100:00100000:3.0:1788744361.313469:0:5837:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff940ac6132c00:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1788744361.313687:0:10823:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff940ad0da9400:10823] 4 exiting: rc = 0 00000100:00100000:2.0:1788744361.314466:0:6704:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff940affae6400:6704] 3 exiting: rc = 0 00000100:00100000:0.0:1788744361.314667:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314681:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314688:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314696:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314710:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314717:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314725:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314731:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314737:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314759:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314777:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314784:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314791:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314797:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314809:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314816:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314823:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314829:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314835:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314846:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314851:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314855:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314861:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314866:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314871:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314877:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314882:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314887:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314892:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314898:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314904:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314909:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314914:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314919:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314924:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314929:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314935:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314939:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314944:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314949:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314955:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314960:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314965:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314977:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314982:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314988:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.314994:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315000:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315005:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315011:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315016:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315021:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315026:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315031:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315036:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315042:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315049:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315054:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315060:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315065:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315072:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315078:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.315094:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744361.324095:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff940ac363ca00:5839] 0 exiting: rc = 1 00000100:00100000:1.0:1788744361.324281:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff940ac363dc00:5840] 1 exiting: rc = 0 00000100:00100000:3.0:1788744361.324352:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324362:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324372:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324379:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324386:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324392:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324399:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324406:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324412:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324417:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324423:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324429:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324438:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324443:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324448:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324453:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324457:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324460:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324464:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324468:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324471:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324476:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324479:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324482:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324485:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324489:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324493:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324496:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324500:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324504:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324508:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324528:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324532:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324538:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324543:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324574:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324581:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324587:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324593:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324599:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324606:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324612:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324618:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324625:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324632:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324639:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324647:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324654:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324660:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324667:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324674:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324682:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324689:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324696:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324703:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324708:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324714:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324720:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324727:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324733:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324744:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324751:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324756:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744361.324762:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744361.325324:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff940ad305be00:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1788744361.326132:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff940ad305ae00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1788744361.327779:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327803:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327812:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327819:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327827:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327834:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327849:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327856:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327862:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327935:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327942:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327948:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327956:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327976:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327981:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327988:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.327994:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328001:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328008:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328015:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328022:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328048:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328057:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328066:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328074:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328092:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328113:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328130:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328136:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328145:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328151:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328157:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328167:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328192:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328200:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328206:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328212:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328221:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328227:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328232:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328239:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328244:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328248:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328253:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328258:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328279:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328293:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328302:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328313:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328320:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328326:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328332:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328337:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328344:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328350:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328356:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328363:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328392:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328399:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328405:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328412:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328418:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.328424:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744361.341874:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff940ad305b200:5843] 0 exiting: rc = 1 00000100:00100000:3.0:1788744361.342044:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff940ad305a600:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1788744361.342171:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342177:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342181:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342184:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342187:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342191:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342194:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342197:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342200:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342204:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342207:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342211:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342214:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342217:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342221:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342224:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342227:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342230:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342233:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342236:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342249:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342252:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342255:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342258:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342261:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342265:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342269:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342274:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342279:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342284:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342288:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342293:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342297:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342302:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342307:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342313:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342319:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342324:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342328:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342333:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342338:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342343:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342349:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342354:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342360:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342365:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342370:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342376:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342381:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342385:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342390:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342395:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342400:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342405:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342410:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342422:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342427:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342432:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342437:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342442:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342448:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342453:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342458:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.342464:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788744361.343171:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff940ad2725000:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1788744361.343256:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff940ad2725a00:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1788744361.343361:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343367:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343373:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343378:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343383:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343388:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343393:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343398:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343403:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343408:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343413:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343418:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343423:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343428:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343434:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343440:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343445:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343450:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343454:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343459:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343464:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343469:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343474:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343479:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343485:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343490:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343505:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343510:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343515:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343520:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343526:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343531:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343536:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343541:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343742:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343752:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343757:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343762:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343766:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343772:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343777:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343782:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343787:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343791:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343796:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343801:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343806:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343811:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343817:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343822:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343827:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343832:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343837:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343842:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343847:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343852:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343857:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343862:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343868:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343873:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343878:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343892:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343897:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.343902:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.344398:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff940ad316fc00:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1788744361.344486:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff940ad316e000:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1788744361.344756:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344762:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344768:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344774:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344780:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344785:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344790:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344795:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344799:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344804:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344809:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344814:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344819:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344825:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344831:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344836:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344841:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344847:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344853:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344859:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344866:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344871:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344876:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344882:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344888:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344895:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344901:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344978:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344986:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344992:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.344999:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345005:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345021:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345026:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345031:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345036:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345042:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345047:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345053:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345058:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345063:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345068:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345073:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345079:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345085:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345091:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345097:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345102:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345107:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345113:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345128:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345133:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345139:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345144:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345150:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345155:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345160:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345165:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345170:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345176:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345180:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345186:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345192:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.345197:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744361.346157:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff940ac363c400:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1788744361.346434:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff940ad04c6c00:5851] 2 exiting: rc = 0 00000100:00100000:3.0:1788744361.346631:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff940ad04c7a00:5850] 1 exiting: rc = 0 00000100:00100000:0.0:1788744361.346721:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346728:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346735:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346751:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346757:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346763:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346770:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346776:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346782:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346788:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346809:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346818:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346825:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346831:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346837:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346843:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346850:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346857:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346863:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346870:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346876:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346884:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346893:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346900:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346906:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346914:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346922:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346930:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346938:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346944:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346952:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346959:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346965:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346972:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346979:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346986:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.346994:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347002:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347033:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347041:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347047:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347054:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347060:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347066:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347072:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347079:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347086:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347091:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347098:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347105:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347111:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347130:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347136:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347142:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347149:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347154:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347160:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347166:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347174:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347181:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347188:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347195:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347207:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744361.347212:0:12914:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788744361.361727:0:12914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744361.361744:0:12914:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788744361.361750:0:12914:0:(genops.c:885:class_export_put()) final put ffff940adbf63800/MDS_uuid 00000020:00000080:0.0:1788744361.361755:0:12914:0:(genops.c:844:class_export_destroy()) destroying export ffff940adbf63800/MDS_uuid for MDS 00000020:01000000:0.0:1788744361.361764:0:12914:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788744361.361924:0:12914:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788744361.690828:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744362.716981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744363.747710:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788744364.371489:0:13063:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788744364.381854:0:13063:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788744364.381902:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.381916:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.381924:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.381931:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.381952:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788744364.381957:0:13063:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788744364.381985:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744364.381990:0:13063:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788744364.381997:0:13063:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788744364.382003:0:13063:0:(import.c:65:import_set_state_nolock()) ffff940aff841000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788744364.382007:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788744364.382009:0:13063:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788744364.382012:0:13063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788744364.383224:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744364.383237:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.383249:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:3.0:1788744364.383254:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.383265:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744364.383273:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744364.383279:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744364.383282:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788744364.383285:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788744364.383328:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.383335:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788744364.383366:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.383373:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b94646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9464d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744364.383385:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744364.383386:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744364.383388:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744364.383418:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068478464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744364.383488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744364.383590:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478464 00000100:00100000:3.0:1788744364.383598:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478464 00000100:00100000:3.0:1788744364.383635:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744364.383642:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875634068478464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788744364.383649:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744364 with bad export cookie 8994462331148256047 00010000:00010000:2.0:1788744364.386874:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386896:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386904:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386911:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386939:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744364.386947:0:13063:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386954:0:13063:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386960:0:13063:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386966:0:13063:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744364.386983:0:13063:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788744364.386987:0:13063:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788744364.387015:0:13063:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788744364.387019:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788744364.387024:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744364.387029:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788744364.387049:0:13063:0:(genops.c:1818:print_export_data()) lustre-OST0000: UNLINKED ffff9409c118b800 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967325 stale:0 00000020:00080000:2.0:1788744364.387066:0:13063:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff940ad0d419c0) has no exports 00000020:00080000:2.0:1788744364.387089:0:13063:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff940ad0d419c0) has no exports 00010000:00010000:0.0:1788744364.390067:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744364.390081:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390095:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297600 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744364.390099:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390110:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744364.390117:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744364.390123:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788744364.390126:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788744364.390130:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788744364.390173:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390180:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744364.390219:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390225:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7297600/0x7cd2bfd5e1b94654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b9465b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390237:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744364.390241:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390246:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7297800 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744364.390264:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390271:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744364.390277:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744364.390282:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788744364.390284:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788744364.390286:0:5824:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788744364.390297:0:5824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390302:0:5824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744364.390307:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390313:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7297800/0x7cd2bfd5e1b9487d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7cd2bfd5e1b94884 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744364.390319:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744364.390321:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744364.390322:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744364.390893:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744364.392243:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068478592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744364.392336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744364.392426:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744364.392434:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068478720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744364.392457:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744364.392493:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478592 00000100:00100000:1.0:1788744364.392502:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478592 00000100:00100000:1.0:1788744364.392538:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068478720 00000100:00100000:1.0:1788744364.392542:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068478720 00000100:00100000:1.0:1788744364.392573:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744364.392581:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875634068478592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744364.392604:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744364 with bad export cookie 8994462331148256047 00000100:00100000:1.0:1788744364.392655:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875634068478592:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (319us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744364.392662:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744364.392679:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788744364.392683:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875634068478720:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788744364.392687:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788744364 with bad export cookie 8994462331148256047 00000100:00100000:1.0:1788744364.392710:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875634068478720:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (253us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788744364.392716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788744364.392751:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788744364.392755:0:3312:0:(import.c:65:import_set_state_nolock()) ffff940ac65e1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788744364.392759:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788744364.412030:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.156@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788744364.412036:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788744364.412048:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940af73a9f80 x1875634068478464/t0(0) o103->MGC192.168.204.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744380 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744364.415260:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940ad31e6a00 x1875634068478592/t0(0) o103->MGC192.168.204.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744380 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744364.415275:0:3312:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940ad31e4380 x1875634068478720/t0(0) o103->MGC192.168.204.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788744380 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788744364.415285:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788744364.415288:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788744364.415290:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788744364.415295:0:3312:0:(import.c:65:import_set_state_nolock()) ffff940ac65e1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744364.415305:0:3312:0:(import.c:545:import_select_connection()) MGC192.168.204.156@tcp: connect to NID 0@lo last attempt 177 00000100:00080000:1.0:1788744364.415323:0:3312:0:(import.c:666:import_select_connection()) MGC192.168.204.156@tcp: import ffff940ac65e1000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:0.0:1788744364.415597:0:3312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad31e4a80 x1875634068478848/t0(0) o250->MGC192.168.204.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744364.415649:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068478592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744364.415681:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3312:1875634068478720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744364.415839:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3309:1875634068478848:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788744364.415890:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875634068478848 offset 0 length 520: 4 00000100:00100000:2.0:1788744364.416017:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3311:1875634068478464:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1788744364.419114:0:5822:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875634068478464 offset 224 length 224: 4 00000100:00100000:2.0:1788744364.419141:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875634068478464:12345-0@lo:103:ldlm_bl.0 Request processed in 35496us (35651us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788744364.419163:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788744364.764280:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788744365.122158:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744365.122169:0:6708:0:(genops.c:885:class_export_put()) final put ffff9409c118b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788744365.122226:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff9409c118b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788744365.122280:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9409c118f000 for lustre-OST0000 00000001:00100000:0.0:1788744365.634129:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788744365.634138:0:7639:0:(genops.c:885:class_export_put()) final put ffff9409c2136000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788744365.634365:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9409c2136000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788744365.634486:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9409c2130800 for lustre-OST0001 00010000:00010000:0.0:1788744365.786713:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788744366.107602:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744366.107610:0:1343:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744366.107613:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788744366.107617:0:1343:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788744366.107622:0:1343:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744366.107630:0:1343:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 433 00000100:00080000:1.0:1788744366.107637:0:1343:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788744366.107649:0:1343:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff940ace4e2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744366.107687:0:1343:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b71c00 x1875634068478976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744366.107971:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068478976:0@lo:38:kworker.0 00000400:00000100:3.0:1788744366.108017:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875634068478976 offset 0 length 520: 4 00000020:01000000:2.0:1788744366.428540:0:13063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ac338c840 - data ffff940affe37d80/ffff940ace4a8400 00000020:01000000:2.0:1788744366.428686:0:13063:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ad0fb9660 - data ffff940ac47550d8/ffff940ac7f24400 00100000:10000000:2.0:1788744366.437457:0:13063:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788744366.490920:0:13063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94455 00000020:00000080:0.0:1788744366.490931:0:13063:0:(genops.c:885:class_export_put()) final put ffff940affaf3000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788744366.490944:0:13063:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940aceda7000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788744366.490947:0:13063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940aceda7000 2 00000020:01000004:0.0:1788744366.490950:0:13063:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff940aceda7000 from lustre-OST0000 00000020:00000080:0.0:1788744366.490973:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788744366.490983:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788744366.490986:0:13063:0:(genops.c:885:class_export_put()) final put ffff940aff847800/lustre-OST0000_UUID 00000020:00000080:0.0:1788744366.490988:0:13063:0:(genops.c:844:class_export_destroy()) destroying export ffff940aff847800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788744366.490995:0:13063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788744366.491384:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940affaf3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788744366.491898:0:13063:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788744366.491905:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788744366.491910:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744366.491916:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788744366.491923:0:13063:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff940aff841800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788744366.491930:0:13063:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9409c11e0000) has exports, disconnecting them 00000020:00080000:0.0:1788744366.491935:0:13063:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff940aff841800), last request at 1788744129 00000020:00000080:0.0:1788744366.491939:0:13063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9447f 00000020:00080000:0.0:1788744366.491951:0:13063:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff940aff841800): rc 0 00000020:00000080:0.0:1788744366.491955:0:13063:0:(genops.c:885:class_export_put()) final put ffff940aff841800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788744366.492033:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940aff841800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788744366.500361:0:13063:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788744366.500371:0:13063:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788744366.500375:0:13063:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788744366.500383:0:13063:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788744366.500639:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744366.500649:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788744366.500656:0:13063:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940aceda7000 1 00000020:00000080:1.0:1788744366.500663:0:13063:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9440f 00000020:00000080:1.0:1788744366.500672:0:13063:0:(genops.c:885:class_export_put()) final put ffff940af85b2000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788744366.500678:0:13063:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788744366.500694:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788744366.500698:0:13063:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788744366.500703:0:13063:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff940ad1cd3380) has no exports 00000020:00000080:2.0:1788744366.500771:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940aff841000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788744366.500780:0:37:0:(genops.c:885:class_export_put()) final put ffff940affaf2800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788744366.500783:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940affaf2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788744366.500789:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788744366.500842:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff940af85b2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788744366.544104:0:13063:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788744366.544125:0:13063:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788744366.544132:0:13063:0:(genops.c:885:class_export_put()) final put ffff940aceda1800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788744366.544137:0:13063:0:(genops.c:844:class_export_destroy()) destroying export ffff940aceda1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788744366.544144:0:13063:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788744366.544525:0:13063:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff940aceda3000 00000020:02000400:1.0:1788744366.544612:0:13063:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788744366.810864:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744367.834642:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744368.858850:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744369.120262:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744369.120327:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744369.120342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788744369.120346:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1788744369.448992:0:13216:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788744369.470874:0:13216:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788744369.471260:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.471278:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.471286:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.471294:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.471322:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788744369.471328:0:13216:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788744369.471364:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744369.471379:0:13216:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940b00b71c00 x1875634068478976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744381 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744369.471411:0:13216:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788744369.471419:0:13216:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788744369.471428:0:13216:0:(import.c:65:import_set_state_nolock()) ffff940ace4e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788744369.471434:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788744369.471438:0:13216:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940b00b71c00 x1875634068478976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788744381 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744369.471445:0:13216:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788744369.471462:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788744369.472223:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068478976:0@lo:38:kworker.0 00010000:00010000:3.0:1788744369.474379:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744369.474398:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744369.474412:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:3.0:1788744369.474416:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744369.474428:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788744369.474435:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744369.474442:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788744369.474446:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788744369.474450:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788744369.474474:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff940ac65e1000 00010000:00010000:3.0:1788744369.474479:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744369.474516:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7296000/0x7cd2bfd5e1b9462a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94631 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744369.474529:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744369.474531:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744369.474532:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744369.477240:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477261:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477269:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477275:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477369:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744369.477377:0:13216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477384:0:13216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477391:0:13216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744369.477397:0:13216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480348:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788744369.480366:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480378:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7296200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744369.480383:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480393:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744369.480401:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744369.480406:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788744369.480409:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788744369.480427:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff940ac65e1000 00010000:00010000:1.0:1788744369.480431:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480465:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7296200/0x7cd2bfd5e1b94638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b9463f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480483:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744369.480488:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480493:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2e00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744369.480496:0:5824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480502:0:5824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744369.480507:0:5824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744369.480512:0:5824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788744369.480515:0:5824:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788744369.480520:0:5824:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff940ac65e1000 00010000:00010000:1.0:1788744369.480522:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744369.480542:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744369.480545:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744369.480565:0:5824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744369.480685:0:13216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788744369.480693:0:13216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af73d2e00/0x7cd2bfd5e1b9486f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94876 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744369.480711:0:13216:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788744369.480724:0:13216:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788744369.480726:0:13216:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788744369.480759:0:13216:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788744369.480763:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788744369.480769:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788744369.480842:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788744369.480847:0:13216:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff940ad0ce8000) has no exports 00000020:00080000:0.0:1788744369.480877:0:13216:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff940ad0ce8000) has no exports 00010000:00010000:3.0:1788744369.481367:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788744369.485733:0:13216:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ac338cde0 - data ffff940affe10948/ffff940b00bd4000 00000020:01000000:0.0:1788744369.485972:0:13216:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff940ad3066060 - data ffff940ac4683000/ffff940af772a000 00100000:10000000:0.0:1788744369.505692:0:13216:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788744369.562125:0:13216:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b9452e 00000020:00000080:2.0:1788744369.562197:0:13216:0:(genops.c:885:class_export_put()) final put ffff940ace2b3000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788744369.562254:0:13216:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940b004f2800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788744369.562259:0:13216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940b004f2800 2 00000020:01000004:2.0:1788744369.562263:0:13216:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff940b004f2800 from lustre-OST0001 00000020:00000080:2.0:1788744369.562314:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744369.562325:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788744369.562337:0:13216:0:(genops.c:885:class_export_put()) final put ffff940b004f1800/lustre-OST0001_UUID 00000020:00000080:2.0:1788744369.562340:0:13216:0:(genops.c:844:class_export_destroy()) destroying export ffff940b004f1800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788744369.562347:0:13216:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788744369.562457:0:13216:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18->MGS 00010000:00010000:2.0:1788744369.562477:0:13216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac164ea00/0x7cd2bfd5e1b94432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744369.562492:0:13216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac164ea00/0x7cd2bfd5e1b94432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744369.562501:0:13216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788744369.562504:0:13216:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788744369.562509:0:13216:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788744369.562538:0:13216:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff940ac65e1000 00010000:00010000:2.0:1788744369.562543:0:13216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac164ea00/0x7cd2bfd5e1b94432 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94439 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744369.562670:0:13216:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744369.562678:0:13216:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744369.562684:0:13216:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788744369.562686:0:13216:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788744369.562689:0:13216:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788744369.562701:0:13216:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff940ac65e1000 00010000:00010000:2.0:1788744369.562704:0:13216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7388200/0x7cd2bfd5e1b9467e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7cd2bfd5e1b94685 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788744369.562724:0:13216:0:(import.c:65:import_set_state_nolock()) ffff940ac65e1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788744369.562736:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788744369.562738:0:13216:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788744369.562740:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788744369.562745:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788744369.562760:0:13216:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff940ad31e4a80 x1875634068478848/t0(0) o250->MGC192.168.204.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788744374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788744369.563012:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744369.563015:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:3.0:1788744369.565697:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ace2b3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788744369.566175:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18:3309:1875634068478848:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788744369.566291:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744369.566305:0:13216:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94321 00000020:00000080:2.0:1788744369.566315:0:13216:0:(genops.c:885:class_export_put()) final put ffff940adbf64800/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 00000020:01000000:2.0:1788744369.566335:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.156@tcp (flags='') 00000020:00000080:2.0:1788744369.566344:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744369.566352:0:13216:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788744369.566356:0:13216:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff940ad0d43380) has no exports 10000000:01000000:2.0:1788744369.566380:0:5833:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788744369.566448:0:13216:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.156@tcp: client import never connected 00000100:00080000:2.0:1788744369.566452:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788744369.566455:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788744369.566457:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788744369.566459:0:13216:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788744369.566490:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788744369.566497:0:13216:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.156@tcp (uuid 1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18) 00000020:01000000:2.0:1788744369.566502:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788744369.566505:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788744369.566508:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788744369.566512:0:13216:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff940ace4e1800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788744369.566518:0:13216:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff940ad1cd4d40) has exports, disconnecting them 00000020:00080000:2.0:1788744369.566522:0:13216:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff940ace4e1800), last request at 1788744151 00000020:00000080:2.0:1788744369.566538:0:13216:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b94558 00000020:00080000:2.0:1788744369.566567:0:13216:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff940ace4e1800): rc 0 00000020:00000080:2.0:1788744369.566571:0:13216:0:(genops.c:885:class_export_put()) final put ffff940ace4e1800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788744369.567616:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940adbf64800/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 for MGC192.168.204.156@tcp 00000020:00000080:0.0:1788744369.567634:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ac65e1000 for MGC192.168.204.156@tcp 00000020:00000080:0.0:1788744369.567663:0:1343:0:(genops.c:885:class_export_put()) final put ffff940ad2f17800/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 00000020:00000080:0.0:1788744369.567665:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ad2f17800/1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18 for MGC192.168.204.156@tcp 00000020:01000000:0.0:1788744369.567669:0:1343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.156@tcp (1fc3ef1b-07b5-49bb-a2ba-0f5a7da1ca18) 00010000:01000000:3.0:1788744369.568802:0:13216:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788744369.568807:0:13216:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788744369.568811:0:13216:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788744369.568818:0:13216:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788744369.569439:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744369.569448:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788744369.569454:0:13216:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940b004f2800 1 00000020:00000080:3.0:1788744369.569460:0:13216:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7cd2bfd5e1b944fd 00000020:00000080:3.0:1788744369.569467:0:13216:0:(genops.c:885:class_export_put()) final put ffff940affa9f000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788744369.569481:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788744369.569485:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744369.569489:0:13216:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788744369.569492:0:13216:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff940ad0ce99c0) has no exports 00010000:00010000:0.0:1788744369.571749:0:5824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788744369.572094:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788744369.572403:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff940af85b9c00:5819] 0 exiting: rc = 1 00000100:00100000:3.0:1788744369.572715:0:8446:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff940af761e200:8446] 2 exiting: rc = 0 00000100:00100000:0.0:1788744369.574695:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff940ac6a05600:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1788744369.574844:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.575745:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff940ad6b5ac00:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788744369.575921:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff940ad0d09800:5823] 2 exiting: rc = 0 00000100:00100000:1.0:1788744369.576064:0:6695:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff940affa44600:6695] 3 exiting: rc = 0 00000100:00100000:3.0:1788744369.576368:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff940ad1814000:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1788744369.576455:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576466:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576473:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576485:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576492:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576499:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576504:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576529:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576536:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576542:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576569:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576576:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576581:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576588:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576594:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576600:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576608:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576613:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576618:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576624:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576630:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576637:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576644:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576649:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576654:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576660:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576665:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576670:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576675:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576680:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576685:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576691:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576696:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576701:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576707:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576712:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576717:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576721:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576726:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576731:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576736:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576741:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576754:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576759:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576764:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576769:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576774:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576779:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576784:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576789:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576793:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576799:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576804:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576809:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576814:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576819:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576825:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576830:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576835:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576840:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576846:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576851:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576856:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.576862:0:1343:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788744369.578939:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ace4e1800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788744369.578953:0:1343:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff940ace4e2800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788744369.578970:0:1343:0:(genops.c:885:class_export_put()) final put ffff940ace4e6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788744369.578973:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940ace4e6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788744369.578978:0:1343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788744369.579123:0:1343:0:(genops.c:844:class_export_destroy()) destroying export ffff940affa9f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788744369.598652:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744369.598670:0:13216:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788744369.602291:0:13216:0:(genops.c:885:class_export_put()) final put ffff940b004f4000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788744369.602303:0:13216:0:(genops.c:844:class_export_destroy()) destroying export ffff940b004f4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788744369.602436:0:13216:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788744369.603379:0:13216:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff940b004f2000 00000020:01000000:3.0:1788744369.603721:0:13216:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788744369.603727:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788744369.603732:0:13216:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788744369.603737:0:13216:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff940ad0d44d40) has no exports 00000020:00000080:3.0:1788744369.603762:0:13216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788744369.605465:0:13216:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788744369.605475:0:13216:0:(genops.c:885:class_export_put()) final put ffff940af85b4000/OSS_uuid 00000020:00000080:3.0:1788744369.605480:0:13216:0:(genops.c:844:class_export_destroy()) destroying export ffff940af85b4000/OSS_uuid for OSS 00000020:01000000:3.0:1788744369.605487:0:13216:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788744369.605562:0:5832:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788744369.606437:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff940ad8181000:6681] 1 exiting: rc = 0 00000100:00100000:1.0:1788744369.606533:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff940ad8181a00:6682] 2 exiting: rc = 0 00000100:00100000:3.0:1788744369.606815:0:11969:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff940adc7c0000:11969] 4 exiting: rc = 0 00000100:00100000:3.0:1788744369.609951:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff940ad8180a00:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1788744369.610496:0:8624:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff940ace782a00:8624] 3 exiting: rc = 0 00000100:00100000:3.0:1788744369.611392:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611407:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611421:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611430:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611436:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611442:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611448:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611487:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611495:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611501:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611507:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611513:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611519:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611524:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611529:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611535:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611541:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611546:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611631:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611636:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611640:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611645:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611650:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611666:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611671:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611677:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611682:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611686:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611691:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611695:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611701:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611706:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611710:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611715:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611721:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611726:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611732:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611736:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611741:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611747:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611752:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611758:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611763:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611768:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611785:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611791:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611796:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611801:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611806:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611811:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611816:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611821:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611826:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611832:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611836:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611840:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611845:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611850:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611862:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611867:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611873:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611877:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611882:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.611888:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788744369.615743:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff940aceeee400:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1788744369.615853:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff940ad8181400:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1788744369.615969:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.615978:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.615983:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.615995:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616000:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616006:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616010:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616015:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616019:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616024:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616029:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616037:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616043:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616047:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616053:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616058:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616063:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616068:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616099:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616228:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616236:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616243:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616248:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616253:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616259:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616264:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616270:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616276:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616281:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616298:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616303:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616308:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616314:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616318:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616324:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616329:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616334:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616340:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616345:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616350:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616354:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616358:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616363:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616368:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616373:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616378:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616383:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616388:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616392:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616397:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616401:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616406:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616411:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616416:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616421:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616425:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616430:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616436:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616440:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616445:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616449:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616454:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616465:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.616473:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.619036:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff940afa94fa00:6687] 2 exiting: rc = 0 00000100:00100000:0.0:1788744369.619542:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff940afa94f000:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1788744369.620460:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff940afa94e400:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1788744369.622666:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622679:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622687:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622705:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622712:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622720:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622725:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622736:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622742:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622748:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622753:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622759:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622765:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622837:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622845:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622850:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622855:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622861:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622866:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622872:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622877:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622884:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622889:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622895:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622900:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622907:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622913:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622918:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622924:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622930:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622936:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622942:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622947:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622952:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.622969:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623241:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623248:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623269:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623275:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623281:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623288:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623295:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623301:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623306:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623313:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623323:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623331:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623337:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623343:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623349:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623355:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623360:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623366:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623372:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623379:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623385:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623392:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623399:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623404:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623409:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623415:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623421:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623427:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.623432:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788744369.632735:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff940b00493200:6689] 1 exiting: rc = 0 00000100:00100000:2.0:1788744369.632909:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff940b00492200:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1788744369.633011:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633020:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633026:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633031:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633038:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633043:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633063:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633068:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633073:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633079:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633084:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633090:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633102:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633109:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633113:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633119:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633124:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633128:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633306:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633313:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633317:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633322:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633328:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633333:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633337:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633342:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633347:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633351:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633356:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633363:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633369:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633377:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633382:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633388:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633392:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633397:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633402:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633407:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633412:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633420:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633426:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633442:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633448:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633453:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633458:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633463:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633468:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633473:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633479:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633489:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633496:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633501:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633506:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633514:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633519:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633524:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633528:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633535:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633540:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633545:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633654:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633661:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633668:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.633675:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.637686:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff940b00493600:6690] 0 exiting: rc = 1 00000100:00100000:1.0:1788744369.638264:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff940b00492400:6691] 1 exiting: rc = 0 00000100:00100000:3.0:1788744369.640403:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640419:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640427:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640436:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640444:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640455:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640464:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640493:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640503:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640510:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640516:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640537:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640543:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640589:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640599:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640610:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640617:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640623:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640629:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640653:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640661:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640669:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640675:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640682:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640689:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640696:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640704:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640710:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640716:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640724:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640730:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640749:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640756:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640762:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640768:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640947:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640966:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640975:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.640994:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641001:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641007:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641015:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641022:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641044:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641052:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641059:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641075:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641081:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641087:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641092:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641101:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641120:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641127:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641248:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641260:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641282:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641290:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641297:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641303:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641309:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641317:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641324:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641330:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788744369.641345:0:13216:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788744369.663000:0:13216:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788744389.140700:0:13833:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788744399.841845:0:14293:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744399.841851:0:14293:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788744399.841982:0:14293:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff940ac2d3a000 00000020:01000004:2.0:1788744399.842003:0:14293:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788744399.842015:0:14293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788744399.842035:0:14293:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff940ad1cd4d40) 00000020:00000080:2.0:1788744399.842052:0:14293:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788744399.862047:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788744399.864165:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788744399.864536:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:0.0:1788744399.864921:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788744399.864992:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 523: rc = 0 00100000:10000000:0.0:1788744399.865094:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 523: rc = 0 00100000:10000000:0.0:1788744399.865247:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 523: rc = 0 00100000:10000000:0.0:1788744399.865344:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:0.0:1788744399.865452:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 523: rc = 0 00100000:10000000:0.0:1788744399.866167:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 525: rc = 0 00100000:10000000:1.0:1788744399.867672:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 664: rc = 0 00100000:10000000:1.0:1788744399.867778:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 664: rc = 0 00100000:10000000:1.0:1788744399.868289:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.868750:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:1.0:1788744399.869009:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.869283:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.869651:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:1.0:1788744399.869919:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:1.0:1788744399.871065:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:1.0:1788744399.871387:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:1.0:1788744399.871801:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.872064:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.872317:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:1.0:1788744399.872855:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:1.0:1788744399.873278:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 680: rc = 0 00100000:10000000:1.0:1788744399.873744:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 680: rc = 0 00100000:10000000:1.0:1788744399.874018:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 680: rc = 0 00100000:10000000:1.0:1788744399.874279:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 680: rc = 0 00100000:10000000:1.0:1788744399.874818:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 680: rc = 0 00100000:10000000:1.0:1788744399.875106:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 680: rc = 0 00100000:10000000:1.0:1788744399.875389:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 680: rc = 0 00100000:10000000:1.0:1788744399.875819:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 680: rc = 0 00100000:10000000:1.0:1788744399.876081:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 680: rc = 0 00100000:10000000:1.0:1788744399.876334:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 680: rc = 0 00100000:10000000:1.0:1788744399.876878:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 680: rc = 0 00100000:10000000:1.0:1788744399.877133:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 680: rc = 0 00100000:10000000:1.0:1788744399.877370:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 680: rc = 0 00100000:10000000:1.0:1788744399.877820:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 680: rc = 0 00100000:10000000:1.0:1788744399.878338:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 680: rc = 0 00100000:10000000:1.0:1788744399.878850:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 680: rc = 0 00100000:10000000:1.0:1788744399.879084:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 680: rc = 0 00100000:10000000:1.0:1788744399.879330:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 680: rc = 0 00100000:10000000:1.0:1788744399.879765:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 680: rc = 0 00100000:10000000:1.0:1788744399.880025:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 680: rc = 0 00100000:10000000:1.0:1788744399.880311:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 680: rc = 0 00100000:10000000:1.0:1788744399.880862:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 680: rc = 0 00100000:10000000:1.0:1788744399.881258:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 680: rc = 0 00100000:10000000:1.0:1788744399.881541:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 680: rc = 0 00100000:10000000:1.0:1788744399.881867:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 680: rc = 0 00100000:10000000:1.0:1788744399.882116:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 680: rc = 0 00100000:10000000:1.0:1788744399.882864:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 680: rc = 0 00100000:10000000:1.0:1788744399.883146:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 680: rc = 0 00100000:10000000:1.0:1788744399.883413:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 680: rc = 0 00100000:10000000:1.0:1788744399.883970:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 680: rc = 0 00100000:10000000:1.0:1788744399.884244:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 680: rc = 0 00100000:10000000:1.0:1788744399.884506:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 680: rc = 0 00100000:10000000:0.0:1788744399.885288:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 671: rc = 0 00100000:10000000:0.0:1788744399.886028:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788744399.886217:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 665: rc = 0 00100000:10000000:0.0:1788744399.886430:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788744399.886502:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 665: rc = 0 00100000:10000000:0.0:1788744399.886962:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788744399.887033:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 665: rc = 0 00100000:10000000:0.0:1788744399.887425:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788744399.887498:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 404: rc = 0 00100000:10000000:0.0:1788744399.887859:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788744399.887927:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 404: rc = 0 00100000:10000000:0.0:1788744399.888105:0:14293:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788744399.888172:0:14293:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 404: rc = 0 00000020:00000080:0.0:1788744399.888479:0:14293:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788744399.888487:0:14293:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788744399.888505:0:14293:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b95614 00000020:01000004:0.0:1788744399.888513:0:14293:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788744399.888518:0:14293:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788744399.888747:0:14293:0:(tgt_mount.c:101:server_register_mount()) register mount ffff940ac2d3a000 from MGS 00000020:01000004:0.0:1788744399.888752:0:14293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788744399.888764:0:14293:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff940ac60a19c0) 00000020:00000080:0.0:1788744399.888776:0:14293:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788744399.888836:0:14293:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940ac2d3a000 from MGS, refs=2 00080000:01000000:0.0:1788744399.888841:0:14293:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744399.888846:0:14293:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b95622 00000100:00100000:0.0:1788744399.888953:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788744399.889077:0:14293:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788744399.889083:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788744399.889770:0:14293:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788744399.889778:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788744399.890252:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744399.890428:0:14293:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788744399.890433:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788744399.891106:0:14293:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788744399.891113:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788744399.891429:0:14293:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788744399.891434:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788744399.892289:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744399.892293:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744399.892296:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744399.892776:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744399.892779:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744399.892780:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744399.893271:0:14293:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788744399.905876:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788744399.907218:0:14293:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788744399.907236:0:14293:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788744399.907238:0:14293:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788744399.918933:0:14302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788744399.919189:0:14293:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788744399.919348:0:14293:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788744399.920062:0:14293:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788744399.920396:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744399.923770:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788744399.923809:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788744399.924974:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788744399.924983:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788744399.927076:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788744399.927086:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788744399.927945:0:14293:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788744399.927971:0:14293:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.156@tcp' 00000020:01000004:3.0:1788744399.927973:0:14293:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788744399.928005:0:14293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.156@tcp (typ=mgc) 00000020:00000080:3.0:1788744399.928019:0:14293:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.156@tcp (ffff9409c11e3380) 00000020:00000080:3.0:1788744399.928036:0:14293:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788744399.928113:0:14293:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9409c2ab0000@MGC192.168.204.156@tcp: add connection 192.168.204.156@tcp at head 00010000:00010000:3.0:1788744399.928276:0:14293:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.156@tcp-0 is initialized 00000040:01000000:3.0:1788744399.928282:0:14293:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788744399.930800:0:14307:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788744399.932965:0:14308:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788744399.933092:0:14293:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.156@tcp (uuid 273d7090-42fe-4f7f-bcb4-bccbf35a43d0) 00000020:00000080:3.0:1788744399.933117:0:14293:0:(genops.c:1384:class_connect()) connect: client 273d7090-42fe-4f7f-bcb4-bccbf35a43d0, cookie 0x7cd2bfd5e1b95630 00000100:00080000:3.0:1788744399.933132:0:14293:0:(import.c:545:import_select_connection()) MGC192.168.204.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788744399.933146:0:14293:0:(import.c:666:import_select_connection()) MGC192.168.204.156@tcp: import ffff9409c2ab0000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:3.0:1788744399.933179:0:14293:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73ab480 x1875634068479104/t0(0) o250->MGC192.168.204.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744399.933255:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3309:1875634068479104:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788744399.933336:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744399.933458:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479104 00000100:00100000:1.0:1788744399.933466:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479104 00000100:00100000:1.0:1788744399.933500:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744399.933507:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875634068479104:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788744399.933540:0:14304:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from 273d7090-42fe-4f7f-bcb4-bccbf35a43d0@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788744399.933595:0:14304:0:(genops.c:1384:class_connect()) connect: client 273d7090-42fe-4f7f-bcb4-bccbf35a43d0, cookie 0x7cd2bfd5e1b95637 00000100:00080000:1.0:1788744399.933748:0:14304:0:(import.c:65:import_set_state_nolock()) ffff940affaf2800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788744399.933865:0:14293:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 273d7090-42fe-4f7f-bcb4-bccbf35a43d0->MGS 00000020:01000004:3.0:1788744399.933886:0:14293:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788744399.933893:0:14293:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788744399.933909:0:14293:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9409c11e4d40) 00000020:00000080:3.0:1788744399.933920:0:14293:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788744399.938588:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:3309:x1875634068479104:12345-0@lo:250:mount.lustre.0 Request processed in 5065us (5236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744399.938607:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744399.944738:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788744399.944757:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.156@tcp: connect to target with instance 0 00000100:00080000:0.0:1788744399.944767:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788744399.944773:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788744399.944785:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9409c2ab0000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788744399.944788:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788744399.944799:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788744399.944808:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3309:1875634068479104:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788744399.946204:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744399.946399:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744399.946406:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788744399.955146:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788744399.955162:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788744399.955539:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788744399.955740:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788744399.956390:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744399.956788:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788744399.956793:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788744399.957438:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788744399.957446:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788744400.000222:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744400.000470:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788744400.000477:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788744400.001974:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788744400.001985:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788744400.002997:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744400.003195:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788744400.003203:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788744400.004284:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744400.004297:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788744400.005045:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744400.005244:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744400.005248:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788744400.006055:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744400.006063:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788744400.006906:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744400.007119:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788744400.007126:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788744400.007932:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788744400.007940:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788744400.025032:0:14293:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788744400.025310:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788744400.025319:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788744400.026978:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788744400.026991:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788744400.028127:0:14293:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788744400.028141:0:14293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788744400.029008:0:14293:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788744400.029036:0:14293:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788744400.029044:0:14293:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788744400.029212:0:14293:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788744400.029256:0:14293:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.156@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788744400.029261:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788744400.029263:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744400.029264:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744400.029265:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744400.029267:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744400.029268:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744400.029270:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744400.029272:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744400.029274:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744400.029276:0:14293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744400.029279:0:14293:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788744400.029281:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788744400.029282:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744400.029283:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744400.029284:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744400.029285:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744400.029286:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744400.029287:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744400.029289:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744400.029289:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744400.029290:0:14293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788744400.029324:0:14293:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788744400.029346:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479232:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788744400.029443:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.029495:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.029595:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479232 00000100:00100000:0.0:1788744400.029604:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479232 00000100:00100000:0.0:1788744400.029647:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744400.029656:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:14293:x1875634068479232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744400.029704:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744400.029707:0:14306:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788744400.029710:0:14306:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788744400.030334:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788744400.030864:0:14306:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788744400.032113:0:14328:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788744400.032120:0:14328:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788744400.032123:0:14328:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788744400.032158:0:14328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788744400.032470:0:14306:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788744400.032480:0:14306:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788744400.039977:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:14293:x1875634068479232:12345-0@lo:253:mount.lustre.0 Request processed in 10314us (10525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.039993:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744400.040102:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788744400.040119:0:14293:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788744400.040123:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788744400.040141:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788744400.040142:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788744400.040143:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788744400.040144:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788744400.040146:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788744400.040147:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788744400.040148:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788744400.040151:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788744400.040152:0:14293:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788744400.040179:0:14293:0:(tgt_mount.c:101:server_register_mount()) register mount ffff940ac2d3a000 from lustre-MDT0000 10000000:01000000:3.0:1788744400.040211:0:14293:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788744400.040214:0:14293:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744400.040221:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9409c11e3380 10000000:01000000:3.0:1788744400.040226:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744400.040238:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9409c11e3380 from 1 10000000:01000000:3.0:1788744400.040242:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788744400.040295:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.040307:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.040319:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.040343:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744400.040393:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.040467:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744400.040761:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479360 00000100:00100000:2.0:1788744400.040772:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479360 00000100:00100000:2.0:1788744400.040880:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744400.040892:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:14293:x1875634068479360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744400.040907:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744400.040926:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9564c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95645 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.040952:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9564c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95645 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.040964:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388000/0x7cd2bfd5e1b9564c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95645 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.040974:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388000, rc 0) 00000100:00100000:2.0:1788744400.041018:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+6:14293:x1875634068479360:12345-0@lo:101:mount.lustre.0 Request processed in 129us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.041025:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744400.041091:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.041107:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.041116:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.041190:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.041220:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.041384:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744400.041444:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479488 00000100:00100000:1.0:1788744400.041449:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479488 00000100:00100000:0.0:1788744400.041497:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744400.041507:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+6:14293:x1875634068479488:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744400.041824:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+6:14293:x1875634068479488:12345-0@lo:501:mount.lustre.0 Request processed in 318us (602us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744400.041831:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744400.041999:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479488:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788744400.042037:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788744400.042064:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042075:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744400.042085:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff940ac2d3a000 10000000:01000000:3.0:1788744400.042090:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788744400.042096:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff940ac2d3a000 10000000:01000000:3.0:1788744400.042098:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788744400.042101:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff940ac2d3a000 from 1 10000000:01000000:3.0:1788744400.042104:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788744400.042128:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042136:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042146:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.042161:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744400.042198:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.042220:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:2.0:1788744400.042294:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479616 00000100:00100000:2.0:1788744400.042300:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479616 00000100:00100000:2.0:1788744400.042325:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788744400.042332:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+6:14293:x1875634068479616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744400.042341:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744400.042353:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388400/0x7cd2bfd5e1b9565a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95653 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.042381:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388400/0x7cd2bfd5e1b9565a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95653 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.042391:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388400/0x7cd2bfd5e1b9565a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95653 expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.042405:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388400, rc 0) 00000100:00100000:2.0:1788744400.042435:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+7:14293:x1875634068479616:12345-0@lo:101:mount.lustre.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.042441:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744400.042583:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.042595:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9565a expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042603:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9565a expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744400.042614:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788744400.042618:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9565a expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042624:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc400/0x7cd2bfd5e1b95653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9565a expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744400.042630:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788744400.042634:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744400.042638:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff940ac2d3a000 10000000:01000000:3.0:1788744400.042641:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788744400.042644:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788744400.042646:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788744400.042662:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042669:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.042676:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.042695:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744400.042721:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.042736:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.042899:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479744 00000100:00100000:0.0:1788744400.042904:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479744 00000100:00100000:0.0:1788744400.042925:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744400.042932:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+7:14293:x1875634068479744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744400.042940:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744400.042951:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa76400/0x7cd2bfd5e1b95668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95661 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.042973:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa76400/0x7cd2bfd5e1b95668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95661 expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.042981:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa76400/0x7cd2bfd5e1b95668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95661 expref: 8 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.042988:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76400, rc 0) 00000100:00100000:0.0:1788744400.043017:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+8:14293:x1875634068479744:12345-0@lo:101:mount.lustre.0 Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.043023:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744400.043185:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.043196:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95668 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.043204:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95668 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.043246:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.043273:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.043301:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.043355:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068479872 00000100:00100000:0.0:1788744400.043360:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068479872 00000100:00100000:0.0:1788744400.043389:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744400.043396:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+8:14293:x1875634068479872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744400.043790:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14293:x1875634068479872:12345-0@lo:501:mount.lustre.0 Request processed in 393us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.043797:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788744400.043945:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068479872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.043979:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744400.044021:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.044050:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620540 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.044166:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480000 00000100:00100000:0.0:1788744400.044172:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480000 00000100:00100000:0.0:1788744400.044193:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744400.044199:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14293:x1875634068480000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744400.044679:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14293:x1875634068480000:12345-0@lo:503:mount.lustre.0 Request processed in 478us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.044686:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744400.044786:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744400.045419:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14329:1875634068480128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744400.045472:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.048211:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af7620300 going to sleep for 11 seconds 00000100:00100000:1.0:1788744400.048931:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480128 00000100:00100000:1.0:1788744400.048946:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480128 00000100:00100000:1.0:1788744400.049019:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788744400.049030:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14329:x1875634068480128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.049451:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14329:x1875634068480128:12345-0@lo:502:llog_process_th.0 Request processed in 422us (3977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.049458:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744400.050120:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14329:1875634068480128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788744400.050160:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744400.050181:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744400.050183:0:14329:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788744400.050189:0:14329:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788744400.050192:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744400.050209:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9409c11e19c0) 00000020:00000080:3.0:1788744400.050228:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788744400.050248:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788744400.050342:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788744400.050351:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b95676 00000020:00000080:3.0:1788744400.052491:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788744400.052507:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744400.052514:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744400.053187:0:14329:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788744400.053195:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744400.053203:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744400.053395:0:14329:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788744400.053403:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788744400.053422:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9409c11e0000) 00000020:00000080:3.0:1788744400.053445:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788744400.053449:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788744400.053451:0:14329:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788744400.053454:0:14329:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788744400.053461:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788744400.053751:0:14329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940ac2d3a000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788744400.053766:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff940af78d3380) 00000020:00000080:3.0:1788744400.053775:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788744400.053843:0:14329:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788744400.053849:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b9568b 00000020:00000080:3.0:1788744400.053976:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788744400.053981:0:14329:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788744400.053985:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7cd2bfd5e1b95692 00080000:01000000:3.0:1788744400.054422:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788744400.054433:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b95699 00010000:00010000:1.0:1788744400.125251:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788744400.126211:0:14329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788744400.126471:0:14329:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788744400.127282:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff940ac60a0000) 00000020:00000080:0.0:1788744400.127303:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788744400.127397:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788744400.127407:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b956a7 00000020:00000080:3.0:1788744400.133364:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788744400.137821:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7cd2bfd5e1b956ae 00000020:00000080:2.0:1788744400.140206:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788744400.140222:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744400.140232:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744400.140234:0:14329:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788744400.140238:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788744400.140241:0:14329:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788744400.140243:0:14329:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744400.140244:0:14329:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788744400.140246:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788744400.140248:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744400.140250:0:14329:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788744400.140252:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744400.140257:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744400.140259:0:14329:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788744400.140263:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788744400.140313:0:14329:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788744400.140333:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744400.140336:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744400.140338:0:14329:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788744400.140340:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744400.140344:0:14329:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788744400.140347:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744400.140348:0:14329:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788744400.140351:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788744400.140357:0:14329:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.156@tcp to nid 0x20000c0a8cc9c (192.168.204.156@tcp) 00000020:01000000:2.0:1788744400.140397:0:14329:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788744400.140409:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744400.140426:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff940ad1cd3380) 00000020:00000080:2.0:1788744400.140444:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788744400.140449:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788744400.140511:0:14329:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788744400.140530:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788744400.140539:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b956bc 00010000:00080000:2.0:1788744400.140600:0:14329:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940acdcd1800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:2.0:1788744400.140833:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788744400.141236:0:14329:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788744400.141283:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788744400.142308:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744400.142395:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788744400.142476:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788744400.149825:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788744400.149834:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788744400.151034:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744400.151048:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744400.151082:0:14329:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788744400.151108:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b956c3 00000100:00080000:1.0:1788744400.151119:0:14329:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744400.151131:0:14329:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff940acdcd1800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744400.151167:0:14329:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b71c00 x1875634068480256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788744400.151200:0:14329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788744400.151269:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.151274:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.151275:0:14329:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788744400.151278:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788744400.151281:0:14329:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788744400.151283:0:14329:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744400.151284:0:14329:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788744400.151286:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788744400.151288:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.151290:0:14329:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788744400.151292:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788744400.151296:0:14329:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788744400.151300:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.151301:0:14329:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788744400.151304:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788744400.151308:0:14329:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.156@tcp to nid 0x20000c0a8cc9c (192.168.204.156@tcp) 00000020:01000000:1.0:1788744400.151331:0:14329:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788744400.151334:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788744400.151346:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff940ad0ce99c0) 00000020:00000080:1.0:1788744400.151358:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788744400.151363:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788744400.151430:0:14329:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788744400.151437:0:14329:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788744400.151445:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7cd2bfd5e1b956d1 00010000:00080000:1.0:1788744400.151473:0:14329:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940ad0cf2800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:1.0:1788744400.151784:0:14329:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788744400.151977:0:14329:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788744400.151998:0:14329:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1788744400.153094:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068480256:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788744400.153150:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634068480256 offset 0 length 520: 4 00000040:00080000:1.0:1788744400.153316:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744400.153409:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788744400.153479:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788744400.154312:0:14335:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744400.154318:0:14335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788744400.155738:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788744400.155753:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788744400.155790:0:14329:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788744400.155809:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b956d8 00000100:00080000:1.0:1788744400.155821:0:14329:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744400.155832:0:14329:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744400.155870:0:14329:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b71500 x1875634068480384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744400.155929:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068480384:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788744400.155982:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634068480384 offset 0 length 520: 4 00000100:00080000:1.0:1788744400.156042:0:14329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788744400.156102:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.156106:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.156108:0:14329:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788744400.156111:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744400.156115:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.156116:0:14329:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788744400.156119:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788744400.156121:0:14329:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788744400.156123:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.156125:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.156127:0:14329:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788744400.156129:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744400.156131:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.156132:0:14329:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788744400.156137:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788744400.156175:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14329:1875634068480512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.156238:0:14329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.156254:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744400.156357:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480512 00000100:00100000:2.0:1788744400.156365:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480512 00000100:00100000:2.0:1788744400.156421:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788744400.156432:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14329:x1875634068480512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788744400.156781:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14329:x1875634068480512:12345-0@lo:502:llog_process_th.0 Request processed in 349us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.156790:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744400.157358:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14329:1875634068480512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744400.157403:0:14329:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.157410:0:14329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.157412:0:14329:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788744400.157416:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788744400.157655:0:14293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788744400.157682:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788744400.157708:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95668 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.157721:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fd600/0x7cd2bfd5e1b95661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95668 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744400.157730:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac2d3a000 from 1 10000000:01000000:0.0:1788744400.157733:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788744400.157776:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.157785:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.157794:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744400.157814:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744400.157865:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744400.157905:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af8502c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.157926:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480640 00000100:00100000:0.0:1788744400.157932:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480640 00000100:00100000:0.0:1788744400.158031:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744400.158039:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+9:14293:x1875634068480640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744400.158051:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744400.158063:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b956df expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.158085:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.158095:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 10 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.158105:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76800, rc 0) 00000100:00100000:0.0:1788744400.158138:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+10:14293:x1875634068480640:12345-0@lo:101:mount.lustre.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.158145:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744400.158342:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744400.158355:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.158363:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744400.159267:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480768:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788744400.159334:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.159432:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744400.159472:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480768 00000100:00100000:2.0:1788744400.159479:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480768 00000100:00100000:2.0:1788744400.159731:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788744400.159742:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+10:14293:x1875634068480768:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788744400.159768:0:14304:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788744400.159776:0:14304:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788744400.159879:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+10:14293:x1875634068480768:12345-0@lo:256:mount.lustre.0 Request processed in 139us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.159899:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788744400.160003:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480768:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788744400.160617:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744400.160636:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.160649:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744400.160658:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac2d3a000 from 1 10000000:01000000:1.0:1788744400.160660:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744400.160697:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.160704:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.160713:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744400.160742:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788744400.160784:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.161105:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.164345:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068480896 00000100:00100000:0.0:1788744400.164365:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068480896 00000100:00100000:0.0:1788744400.164438:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788744400.164449:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+10:14293:x1875634068480896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744400.164469:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744400.164505:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b956ed expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.164636:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.164649:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.164659:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77200, rc 0) 00000100:00100000:0.0:1788744400.164941:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068480896:12345-0@lo:101:mount.lustre.0 Request processed in 492us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.164949:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788744400.165108:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068480896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.165132:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.165143:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.165225:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.165265:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.165342:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa5c69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744400.165365:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481024 00000100:00100000:3.0:1788744400.165379:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481024 00000100:00100000:0.0:1788744400.165422:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788744400.165430:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068481024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744400.165977:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068481024:12345-0@lo:501:mount.lustre.0 Request processed in 546us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.165984:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788744400.166079:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744400.166112:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744400.166159:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.166188:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.166248:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481152 00000100:00100000:0.0:1788744400.166253:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481152 00000100:00100000:0.0:1788744400.166322:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744400.166330:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068481152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744400.166494:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068481152:12345-0@lo:503:mount.lustre.0 Request processed in 164us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.166500:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788744400.166785:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744400.167175:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14337:1875634068481280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.167228:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.167263:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629540 going to sleep for 11 seconds 00000100:00100000:3.0:1788744400.167303:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481280 00000100:00100000:3.0:1788744400.167309:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481280 00000100:00100000:3.0:1788744400.167383:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744400.167391:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14337:x1875634068481280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788744400.167673:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14337:x1875634068481280:12345-0@lo:502:llog_process_th.0 Request processed in 283us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744400.167681:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744400.167793:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14337:1875634068481280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788744400.167819:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744400.167828:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.167830:0:14337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788744400.167837:0:14337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ac2d3a000 00000020:00000080:1.0:1788744400.167840:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744400.167848:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.167850:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.167851:0:14337:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788744400.167853:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744400.167855:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.167857:0:14337:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788744400.167860:0:14337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ac2d3a000 00000020:00000080:1.0:1788744400.167862:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788744400.167925:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788744400.169595:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.169603:0:14337:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788744400.169613:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788744400.169619:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788744400.169620:0:14337:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788744400.169625:0:14337:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff940ac2d3a000 00000020:00000080:1.0:1788744400.169628:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788744400.171695:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14337:1875634068481408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744400.171780:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744400.171834:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481408 00000100:00100000:0.0:1788744400.171841:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481408 00000100:00100000:0.0:1788744400.171892:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744400.171901:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14337:x1875634068481408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788744400.172132:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14337:x1875634068481408:12345-0@lo:502:llog_process_th.0 Request processed in 231us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744400.172140:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788744400.172202:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744400.172225:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14337:1875634068481408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788744400.172261:0:14337:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744400.172270:0:14337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744400.172272:0:14337:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744400.172279:0:14337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788744400.172490:0:14293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788744400.172515:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788744400.172571:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172586:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788744400.172639:0:14293:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788744400.172643:0:14293:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff940ac2d3a000 10000000:01000000:3.0:1788744400.172645:0:14293:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff940ac2d3a000 10000000:01000000:3.0:1788744400.172649:0:14293:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788744400.172655:0:14293:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ac2d3a000 from 1 10000000:01000000:3.0:1788744400.172658:0:14293:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788744400.172686:0:14293:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172695:0:14293:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172704:0:14293:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.172717:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481536:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744400.172750:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.172777:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa5c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744400.172795:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481536 00000100:00100000:3.0:1788744400.172800:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481536 00000100:00100000:3.0:1788744400.172832:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744400.172840:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068481536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.172864:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744400.172883:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b95702 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b956fb expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172909:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b95702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956fb expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172920:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fd400/0x7cd2bfd5e1b95702 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956fb expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.172929:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fd400, rc 0) 00000100:00100000:3.0:1788744400.172958:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068481536:12345-0@lo:101:mount.lustre.0 Request processed in 120us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744400.172964:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744400.172999:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744400.173013:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95702 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744400.173022:0:14293:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95702 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744400.173066:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.173091:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.173103:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa5c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744400.173115:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481664 00000100:00100000:3.0:1788744400.173120:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481664 00000100:00100000:3.0:1788744400.173136:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744400.173142:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068481664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.173399:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068481664:12345-0@lo:501:mount.lustre.0 Request processed in 256us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744400.173407:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744400.173438:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744400.173466:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744400.173504:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744400.173518:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa5c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788744400.173531:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481792 00000100:00100000:3.0:1788744400.173535:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481792 00000100:00100000:3.0:1788744400.173578:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744400.173585:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068481792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744400.173723:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068481792:12345-0@lo:503:mount.lustre.0 Request processed in 139us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744400.173730:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744400.173766:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068481792:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744400.177002:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14339:1875634068481920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.177089:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.177131:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068481920 00000100:00100000:1.0:1788744400.177139:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068481920 00000100:00100000:1.0:1788744400.177183:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744400.177193:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14339:x1875634068481920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.177460:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14339:x1875634068481920:12345-0@lo:502:llog_process_th.0 Request processed in 267us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.177468:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788744400.177808:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad69c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788744400.177834:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14339:1875634068481920:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788744400.177905:0:14339:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788744400.177920:0:14339:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff940ad0ce8000) 00000020:00000080:1.0:1788744400.177943:0:14339:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788744400.178018:0:14339:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940ac2d3a000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788744400.178022:0:14339:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940ac2d3a000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788744400.178024:0:14339:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940ac2d3a000 4 00010000:00080000:1.0:1788744400.178052:0:14339:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940b0096e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.156@tcp at head 00010000:00010000:1.0:1788744400.184017:0:14339:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788744400.184220:0:14339:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788744400.184258:0:14339:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744400.184279:0:14339:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7cd2bfd5e1b95710 00000100:00080000:1.0:1788744400.184290:0:14339:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744400.184301:0:14339:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff940b0096e800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744400.184344:0:14339:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b73480 x1875634068482048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744400.184413:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068482048:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744400.184486:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.188035:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482048 00000100:00100000:1.0:1788744400.188049:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482048 00000100:00100000:1.0:1788744400.188095:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744400.188104:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068482048:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744400.188216:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068482048:12345-0@lo:38:llog_process_th.0 Request processed in 113us (3730us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788744400.188223:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744400.188265:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788744400.188275:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940b0096e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788744400.188294:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788744400.188298:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068482048:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788744400.188332:0:14339:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788744400.189775:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14339:1875634068482176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.189859:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.189898:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482176 00000100:00100000:1.0:1788744400.189906:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482176 00000100:00100000:1.0:1788744400.189950:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744400.189958:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14339:x1875634068482176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788744400.190202:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14339:x1875634068482176:12345-0@lo:502:llog_process_th.0 Request processed in 244us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.194499:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788744400.194711:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d84540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744400.194746:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14339:1875634068482176:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788744400.194799:0:14339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788744400.194873:0:14293:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788744400.194902:0:14293:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788744400.194926:0:14293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95702 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.194940:0:14293:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc800/0x7cd2bfd5e1b956fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95702 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788744400.195008:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788744400.195012:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744400.195013:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744400.195014:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744400.195016:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744400.195018:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744400.195019:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744400.195021:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744400.195023:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744400.195025:0:14293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744400.195028:0:14293:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788744400.195031:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744400.195049:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788744400.195050:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744400.195051:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744400.195052:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744400.195053:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744400.195054:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788744400.195055:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788744400.195057:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744400.195058:0:14293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788744400.195088:0:14293:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788744400.195106:0:14293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068482304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744400.195181:0:14293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744400.195210:0:14293:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac12ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1788744400.195229:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482304 00000100:00100000:1.0:1788744400.195236:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482304 00000100:00100000:1.0:1788744400.195276:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788744400.195286:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14293:x1875634068482304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788744400.195312:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788744400.195327:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788744400.249528:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744400.249573:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788744400.250326:0:14327:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788744400.250333:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788744400.250359:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.250389:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.250398:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.250450:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744400.250467:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 12 pid: 14306 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744400.250507:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068482432:0@lo:104: 00000100:00100000:0.0:1788744400.250621:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744400.250667:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0401f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788744400.250764:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482432 00000100:00100000:2.0:1788744400.250773:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482432 00000100:00100000:2.0:1788744400.250832:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744400.250842:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068482432:12345-0@lo:104: 00010000:00010000:2.0:1788744400.250854:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.250917:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788744400.250924:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068482432:12345-0@lo:104: Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.250931:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788744400.250952:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744400.250958:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.250965:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76200 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744400.250969:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.250976:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744400.250983:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744400.250989:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744400.251024:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251042:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744400.251062:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251069:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940afaa76200/0x7cd2bfd5e1b956df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956e6 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251085:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744400.251087:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744400.251088:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744400.251131:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744400.251140:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068482560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744400.251169:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744400.251236:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482560 00000100:00100000:2.0:1788744400.251241:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482560 00010000:00010000:2.0:1788744400.251258:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 13 pid: 14306 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744400.251278:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744400.251285:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+13:3311:x1875634068482560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744400.251296:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744400.251301:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 13 pid: 14306 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251313:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 13 pid: 14306 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251331:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251347:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788744400.251362:0:14296:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001029881s 00010000:00010000:2.0:1788744400.251378:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251385:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251392:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251400:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251406:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744400.251410:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251418:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251428:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744400.251438:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744400.251469:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+13:3311:x1875634068482560:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744400.251476:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744400.251526:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068482560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744400.251957:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940afaa76800/0x7cd2bfd5e1b956e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956df expref: 12 pid: 14306 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744400.251972:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068482432:0@lo:104: 00010000:00010000:1.0:1788744400.251990:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.251998:0:14327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.252005:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744400.252011:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940afaa77c00/0x7cd2bfd5e1b95717 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744400.265142:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14293:x1875634068482304:12345-0@lo:253:mount.lustre.0 Request processed in 69842us (69945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744400.265164:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744400.265266:0:14293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14293:1875634068482304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744400.265285:0:14293:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788744400.265288:0:14293:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744400.265290:0:14293:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788744400.265292:0:14293:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744400.265293:0:14293:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744400.265294:0:14293:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744400.265296:0:14293:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744400.265297:0:14293:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788744400.265298:0:14293:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788744400.265300:0:14293:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744400.265302:0:14293:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744400.265321:0:14293:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788744400.270693:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.270877:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744400.271170:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.271336:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744400.271723:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.271891:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744400.272838:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.273012:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744400.273292:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.273750:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788744400.274012:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788744400.274151:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788744400.300480:0:14293:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788744400.301129:0:14293:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788744400.301587:0:14350:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788744400.301672:0:14350:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788744400.305228:0:14293:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788744400.305388:0:14293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788744400.305818:0:14293:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788744400.305825:0:14293:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788744400.305947:0:14293:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744400.307176:0:14350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788744400.307277:0:14350:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788744400.307283:0:14350:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:3.0:1788744400.307569:0:14349:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788744400.307575:0:14349:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1788744400.308479:0:14293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788744400.309298:0:14293:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788744400.309351:0:14293:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788744400.311309:0:14293:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788744400.317305:0:14293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788744400.344795:0:14293:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788744400.344837:0:14293:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbcb701b9f988 00100000:10000000:0.0:1788744400.344845:0:14293:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788744400.346141:0:14293:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744400.346159:0:14293:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744400.346178:0:14293:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788744400.346208:0:14293:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788744400.922826:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744401.248955:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788744401.691072:0:14308:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744401.691081:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac2d3a000 from 6 10000000:01000000:1.0:1788744401.691086:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744401.691143:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691156:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691170:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744401.691209:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068482688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744401.691289:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744401.691353:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744401.691377:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482688 00000100:00100000:1.0:1788744401.691386:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482688 00000100:00100000:1.0:1788744401.691434:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744401.691443:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14308:x1875634068482688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744401.691457:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744401.691470:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9571e expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691494:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691519:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 12 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691529:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3a00, rc 0) 00000100:00100000:1.0:1788744401.691589:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068482688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744401.691597:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788744401.691648:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068482688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744401.691663:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.691672:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744401.691726:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068482816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744401.691755:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744401.691772:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7ee2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744401.691785:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482816 00000100:00100000:1.0:1788744401.691788:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482816 00000100:00100000:1.0:1788744401.691808:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744401.691814:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068482816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788744401.691829:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744401.691851:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744401.691854:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788744401.691936:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068482816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744401.691952:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788744401.691985:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068482816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788744401.692023:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744401.692031:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744401.692038:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744401.957494:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744402.268724:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788744402.973102:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744403.995502:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744405.022443:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744405.531886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744405.531895:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744405.531908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744405.531911:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788744405.531914:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788744405.531916:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788744405.531920:0:36:0:(import.c:65:import_set_state_nolock()) ffff940b0096e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744405.531937:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff940b0096e800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:3.0:1788744405.531969:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73a8e00 x1875634068483072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744405.532037:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068482944:0@lo:400:kworker.0 00000100:00100000:1.0:1788744405.532104:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744405.532208:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068482944 00000100:00100000:3.0:1788744405.532216:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068482944 00000100:00100000:3.0:1788744405.532277:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788744405.532287:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:3311:x1875634068482944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744405.532347:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:3311:x1875634068482944:12345-0@lo:400:kworker.0 Request processed in 61us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744405.532354:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788744405.532402:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788744405.532577:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068483072:0@lo:38:kworker.0 00000100:00100000:2.0:1788744405.532614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744405.532687:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483072 00000100:00100000:1.0:1788744405.532692:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483072 00000100:00100000:1.0:1788744405.532722:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744405.532728:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875634068483072:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788744405.532753:0:14313:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1788744405.532790:0:14313:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7cd2bfd5e1b9572c 00000004:00100000:1.0:1788744405.532807:0:14313:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744405.532938:0:14313:0:(import.c:65:import_set_state_nolock()) ffff940b00968800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744405.532984:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875634068483072:12345-0@lo:38:kworker.0 Request processed in 254us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744405.532990:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788744405.533276:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff940af73a8e00 x1875634068483072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788744405.533291:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788744405.533300:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788744405.533306:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788744405.533309:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940b0096e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788744405.533316:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875634068483072:0@lo:38:kworker.0 00000001:02000400:1.0:1788744405.728451:0:14594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744406.043563:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744407.071030:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744408.090755:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744409.118795:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744409.471355:0:14746:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7d7c8b00 20000000:00000080:0.0:1788744409.471376:0:14746:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940afa376c00 uarg=0000000000000000 20000000:01000000:0.0:1788744409.471412:0:14746:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788744409.471420:0:14746:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788744409.471425:0:14746:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788744409.476690:0:14747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788744409.477477:0:14746:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788744409.483236:0:14746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788744409.485783:0:14746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.486021:0:14746:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.486032:0:14746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.486092:0:14746:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 11 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744409.486123:0:14746:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 11 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744409.486139:0:14746:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14746:1875634068483200:0@lo:104: 00000100:00100000:1.0:1788744409.486239:0:14746:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744409.486307:0:14746:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af0629a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788744409.486451:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483200 00000100:00100000:0.0:1788744409.486460:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483200 00000100:00100000:0.0:1788744409.486507:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744409.486517:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14746:x1875634068483200:12345-0@lo:104: 00010000:00010000:0.0:1788744409.486532:0:14295:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744409.486616:0:14295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744409.486622:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14746:x1875634068483200:12345-0@lo:104: Request processed in 107us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744409.486629:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744409.486635:0:14746:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14746:1875634068483200:0@lo:104: 00010000:00010000:3.0:1788744409.486658:0:14746:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486707:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744409.486715:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486723:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744409.486728:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486755:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744409.486764:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744409.486772:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788744409.486813:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486819:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788744409.486850:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486858:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af73d2800/0x7cd2bfd5e1b956ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b956f4 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.486875:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744409.486876:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744409.486878:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744409.486895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744409.486903:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068483328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744409.486933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744409.486965:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483328 00000100:00100000:2.0:1788744409.486968:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483328 00010000:00010000:2.0:1788744409.486984:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 12 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744409.487002:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744409.487013:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:3313:x1875634068483328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744409.487023:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744409.487028:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 12 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487039:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 12 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487050:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940afaa77200/0x7cd2bfd5e1b956f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b956ed expref: 12 pid: 14305 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487062:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487070:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487082:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487090:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487096:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487102:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487107:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744409.487110:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487124:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487137:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744409.487146:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744409.487173:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:3313:x1875634068483328:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744409.487180:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744409.487228:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068483328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744409.490370:0:14746:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.490396:0:14746:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744409.490405:0:14746:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d3000/0x7cd2bfd5e1b95733 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744410.157704:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788744410.657859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744410.657866:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788744410.657869:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744410.657872:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788744410.657911:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068483584:0@lo:400:kworker.0 00000100:00100000:2.0:1788744410.657986:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744410.658114:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744400/real 1788744400] req@ffff940b00b71500 x1875634068480384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744410.658136:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff940b00b71500 x1875634068480384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744410.658146:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744400/real 1788744400] req@ffff940b00b71c00 x1875634068480256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744410 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744410.658156:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff940b00b71c00 x1875634068480256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744410 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788744410.658180:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744410.658214:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744410.658218:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068480384:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788744410.658223:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940acdcd1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744410.658228:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788744410.658231:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068480256:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788744410.658618:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744410.658622:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788744410.658624:0:36:0:(import.c:65:import_set_state_nolock()) ffff940acdcd1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744410.658629:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788744410.658634:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744410.658643:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff940acdcd1800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744410.658672:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73ce300 x1875634068483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744410.658685:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744410.658688:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744410.658690:0:36:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744410.658693:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:2.0:1788744410.658695:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788744410.658699:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744410.658709:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73cc380 x1875634068483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744410.658825:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068483456:0@lo:400:kworker.0 00000100:00100000:1.0:1788744410.658879:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744410.658949:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483584 00000100:00100000:1.0:1788744410.658962:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483584 00000100:00100000:1.0:1788744410.659016:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744410.659028:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068483584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744410.659087:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068483584:12345-0@lo:400:kworker.0 Request processed in 60us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744410.659094:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788744410.659119:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483456 00000100:00100000:1.0:1788744410.659122:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483456 00000100:00100000:1.0:1788744410.659148:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788744410.659155:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:3313:x1875634068483456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744410.659209:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:3313:x1875634068483456:12345-0@lo:400:kworker.0 Request processed in 54us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744410.659215:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788744410.659274:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff940af73cdc00 x1875634068483584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744410.659287:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068483584:0@lo:400:kworker.0 00000100:00100000:1.0:1788744410.659331:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068483456:0@lo:400:kworker.0 00000100:00100000:0.0:1788744410.659595:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068483712:0@lo:8:kworker.0 00000400:00000100:0.0:1788744410.659628:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634068483712 offset 0 length 520: 4 00000100:00100000:0.0:1788744410.659651:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068483840:0@lo:8:kworker.0 00000400:00000100:0.0:1788744410.659686:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875634068483840 offset 0 length 520: 4 00010000:00010000:3.0:1788744411.176431:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788744411.292052:0:14308:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744411.292062:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac2d3a000 from 10 10000000:01000000:1.0:1788744411.292068:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744411.292124:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.292138:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.292150:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744411.292189:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068483968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744411.292273:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744411.292367:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac663b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744411.293034:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068483968 00000100:00100000:2.0:1788744411.293048:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068483968 00000100:00100000:2.0:1788744411.293118:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788744411.293130:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+11:14308:x1875634068483968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744411.293147:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744411.293176:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9573a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.293207:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.293220:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744411.293230:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7388800, rc 0) 00000100:00100000:2.0:1788744411.293306:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068483968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.293330:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788744411.294504:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068483968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744411.294527:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744411.294539:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744411.294646:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068484096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744411.294695:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744411.294740:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744411.294801:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484096 00000100:00100000:3.0:1788744411.294807:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484096 00000100:00100000:3.0:1788744411.294838:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744411.294845:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068484096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788744411.295109:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068484096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744411.295116:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788744411.296262:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068484096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744411.296329:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068484224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744411.296393:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744411.296427:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afa6f63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744411.297097:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484224 00000100:00100000:2.0:1788744411.297117:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484224 00000100:00100000:2.0:1788744411.297184:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788744411.297193:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068484224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744411.297433:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14308:x1875634068484224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 240us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744411.297441:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788744411.298432:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068484224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788744411.301788:0:14815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788744411.302232:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788744411.302258:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744411.302272:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744411.302288:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744412.193675:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788744412.519795:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788744413.211896:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744414.244207:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788744415.212617:0:14995:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788744415.212621:0:14995:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788744415.212754:0:14995:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9409c214b000 00000020:01000004:3.0:1788744415.212771:0:14995:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788744415.212784:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788744415.212799:0:14995:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff940af78d4d40) 00000020:00000080:3.0:1788744415.212816:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788744415.229285:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788744415.229643:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788744415.231217:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788744415.231758:0:14995:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788744415.232146:0:14995:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788744415.232897:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1788744415.233092:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1788744415.233260:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1788744415.234431:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 391: rc = 0 00100000:10000000:3.0:1788744415.235158:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 391: rc = 0 00100000:10000000:3.0:1788744415.235759:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 391: rc = 0 00100000:10000000:3.0:1788744415.236213:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 391: rc = 0 00100000:10000000:3.0:1788744415.236620:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 391: rc = 0 00100000:10000000:3.0:1788744415.236892:0:14995:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 391: rc = 0 00000020:00000080:3.0:1788744415.237946:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788744415.237961:0:14995:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744415.237974:0:14995:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7cd2bfd5e1b9574f 00000020:01000004:3.0:1788744415.237986:0:14995:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788744415.238010:0:14995:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744415.238015:0:14995:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744415.238022:0:14995:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788744415.238027:0:14995:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788744415.238043:0:14995:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff940af78d0000) 00000020:00000080:3.0:1788744415.238054:0:14995:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788744415.241156:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788744415.242185:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788744415.242193:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788744415.246270:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744415.246290:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788744415.250219:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788744415.250237:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788744415.254484:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744415.254744:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788744415.254752:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788744415.255931:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788744415.255941:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1788744415.264164:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744415.281940:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788744415.282644:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788744415.282655:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788744415.284757:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788744415.284842:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788744415.286470:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788744415.286482:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788744415.289378:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744415.289905:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788744415.289913:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788744415.291027:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788744415.291038:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788744415.336449:0:14995:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788744415.336693:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788744415.336839:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788744415.338198:0:14995:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788744415.338207:0:14995:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788744415.338837:0:14995:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788744415.338863:0:14995:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788744415.338869:0:14995:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788744415.359006:0:14995:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744415.359056:0:14995:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.156@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788744415.359061:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744415.359063:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744415.359064:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744415.359065:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744415.359067:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744415.359068:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744415.359070:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744415.359072:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744415.359074:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744415.359087:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788744415.359090:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744415.359091:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788744415.359092:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744415.359093:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744415.359094:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744415.359102:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744415.359103:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744415.359104:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744415.359105:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744415.359143:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788744415.359165:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744415.359269:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.359926:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d67840 going to sleep for 11 seconds 00000100:00100000:2.0:1788744415.360248:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484352 00000100:00100000:2.0:1788744415.360258:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484352 00000100:00100000:3.0:1788744415.360920:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788744415.360932:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14995:x1875634068484352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744415.361008:0:14305:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788744415.361011:0:14305:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788744415.361015:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788744415.377188:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14995:x1875634068484352:12345-0@lo:253:mount.lustre.0 Request processed in 16249us (17910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.377208:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788744415.377667:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744415.377685:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788744415.377688:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744415.377690:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744415.377692:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744415.377693:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744415.377694:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744415.377696:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744415.377697:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744415.377700:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744415.377702:0:14995:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788744415.377736:0:14995:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9409c214b000 from lustre-OST0000 10000000:01000000:2.0:1788744415.377775:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788744415.377778:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788744415.377785:0:14995:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9409c11e3380 local copy 00010000:00010000:2.0:1788744415.377799:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744415.378182:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744415.378308:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.378488:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.379128:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484480 00000100:00100000:3.0:1788744415.379139:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484480 00000100:00100000:3.0:1788744415.379222:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788744415.379241:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14995:x1875634068484480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744415.379746:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14995:x1875634068484480:12345-0@lo:501:mount.lustre.0 Request processed in 505us (1436us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744415.379755:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788744415.380709:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484480:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788744415.380740:0:14995:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744415.381145:0:14995:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744415.381159:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.381172:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744415.381205:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9409c214b000 10000000:01000000:2.0:1788744415.381211:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744415.381219:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9409c11e3380 10000000:01000000:2.0:1788744415.381222:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788744415.381298:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9409c11e3380 from 1 10000000:01000000:2.0:1788744415.381301:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788744415.381425:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.381435:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.381446:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744415.381468:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788744415.381818:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744415.382719:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744415.382805:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484608 00000100:00100000:1.0:1788744415.382814:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484608 00000100:00100000:1.0:1788744415.382906:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788744415.382916:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+12:14995:x1875634068484608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744415.382931:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744415.382949:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b95764 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9575d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.382985:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b95764 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9575d expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.382999:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2e00/0x7cd2bfd5e1b95764 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9575d expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.383008:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2e00, rc 0) 00000100:00100000:1.0:1788744415.383073:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+13:14995:x1875634068484608:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.383092:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788744415.383176:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744415.383194:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95764 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.383204:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95764 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744415.383232:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788744415.383249:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95764 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.383256:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7389a00/0x7cd2bfd5e1b9575d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95764 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744415.383263:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788744415.383280:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788744415.383287:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788744415.383289:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788744415.383318:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.383325:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.383333:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744415.383757:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744415.383803:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.384167:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.384290:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484736 00000100:00100000:3.0:1788744415.384299:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484736 00000100:00100000:3.0:1788744415.384351:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788744415.384360:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+13:14995:x1875634068484736:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788744415.384375:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744415.384390:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b95772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9576b expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.384410:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b95772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9576b expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.384421:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac13fc200/0x7cd2bfd5e1b95772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9576b expref: 14 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.384428:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac13fc200, rc 0) 00000100:00100000:3.0:1788744415.384475:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068484736:12345-0@lo:101:mount.lustre.0 Request processed in 116us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.384627:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788744415.384722:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744415.384735:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95772 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.384743:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95772 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788744415.385899:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788744415.387913:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788744415.388485:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788744415.388659:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788744415.388721:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788744415.389093:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788744415.389136:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788744415.389169:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788744415.389331:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788744415.389408:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788744415.389637:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744415.389722:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.390304:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.390728:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484864 00000100:00100000:3.0:1788744415.390737:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484864 00000100:00100000:3.0:1788744415.390830:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788744415.390843:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068484864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744415.391969:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068484864:12345-0@lo:501:mount.lustre.0 Request processed in 1125us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.392117:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744415.392177:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484992:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744415.392251:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744415.392452:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788744415.392777:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.392867:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068484992 00000100:00100000:3.0:1788744415.392877:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068484992 00000100:00100000:3.0:1788744415.392916:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788744415.392924:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068484992:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744415.393433:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068484992:12345-0@lo:503:mount.lustre.0 Request processed in 508us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.393441:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788744415.393892:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068484992:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744415.394752:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744415.394841:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485120:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744415.394923:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.394964:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c30040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.395369:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485120 00000100:00100000:3.0:1788744415.395377:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485120 00000100:00100000:3.0:1788744415.395422:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788744415.395433:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068485120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744415.395944:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068485120:12345-0@lo:502:mount.lustre.0 Request processed in 512us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.395953:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788744415.396090:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485120:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744415.396399:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788744415.396453:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788744415.396488:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788744415.396756:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788744415.396796:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788744415.396830:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788744415.396882:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788744415.396922:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788744415.396972:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788744415.397123:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788744415.397160:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788744415.397209:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788744415.397785:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744415.397873:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.397994:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c30040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744415.398165:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485248 00000100:00100000:1.0:1788744415.398185:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485248 00000100:00100000:3.0:1788744415.398492:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788744415.398606:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068485248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744415.398949:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068485248:12345-0@lo:502:mount.lustre.0 Request processed in 346us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.398965:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788744415.399852:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744415.400169:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788744415.400195:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788744415.401854:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788744415.401874:0:15009:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788744415.401880:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744415.401883:0:15009:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788744415.401890:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788744415.401905:0:15009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff940ad1cd0000) 00000020:00000080:2.0:1788744415.401932:0:15009:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788744415.401938:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788744415.402112:0:15009:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9409c214b000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788744415.402121:0:15009:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788744415.402129:0:15009:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7cd2bfd5e1b95780 00010000:00010000:3.0:1788744415.408170:0:15009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788744415.409058:0:15009:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788744415.416238:0:15009:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788744415.420488:0:15009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788744415.420507:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744415.420517:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.420519:0:15009:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788744415.420526:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788744415.420530:0:15009:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788744415.420532:0:15009:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744415.420534:0:15009:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788744415.420535:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788744415.420538:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.420539:0:15009:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788744415.420542:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744415.421083:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.421087:0:15009:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788744415.421096:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788744415.421099:0:15009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788744415.421103:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744415.421107:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.421108:0:15009:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788744415.421111:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788744415.421115:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.421116:0:15009:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788744415.421120:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788744415.421222:0:15009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788744415.421308:0:15009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788744415.421309:0:15009:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788744415.421313:0:15009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788744415.424672:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788744415.424729:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788744415.424796:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95772 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.424813:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940afaa77200/0x7cd2bfd5e1b9576b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95772 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744415.424823:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9409c214b000 from 1 10000000:01000000:0.0:1788744415.424826:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744415.424876:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.424885:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744415.424897:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744415.424927:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485376:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788744415.425024:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.425089:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9409c3004600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.425474:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485376 00000100:00100000:3.0:1788744415.425496:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485376 00000100:00100000:1.0:1788744415.426520:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788744415.426539:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+14:14995:x1875634068485376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744415.426583:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744415.426609:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95787 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.426638:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 15 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.426651:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 15 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.426661:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3400, rc 0) 00000100:00100000:1.0:1788744415.426982:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485376:12345-0@lo:101:mount.lustre.0 Request processed in 449us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.426990:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788744415.427329:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744415.427424:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.427436:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744415.428166:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788744415.428800:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744415.429528:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788744415.429795:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788744415.429868:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788744415.429876:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788744415.429965:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744415.430122:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.430221:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188480 going to sleep for 11 seconds 00000100:00100000:2.0:1788744415.430258:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485504 00000100:00100000:2.0:1788744415.430265:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485504 00000100:00100000:0.0:1788744415.430754:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788744415.430767:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744415.431212:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485504:12345-0@lo:501:mount.lustre.0 Request processed in 448us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.431221:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788744415.431428:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744415.431481:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744415.431529:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.431634:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188480 going to sleep for 11 seconds 00000100:00100000:1.0:1788744415.431833:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485632 00000100:00100000:1.0:1788744415.431839:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485632 00000100:00100000:0.0:1788744415.431949:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788744415.431956:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485632:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744415.432174:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485632:12345-0@lo:503:mount.lustre.0 Request processed in 217us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.432182:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788744415.432220:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744415.433008:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744415.433100:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744415.433174:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.433350:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188480 going to sleep for 11 seconds 00000100:00100000:0.0:1788744415.433510:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485760 00000100:00100000:0.0:1788744415.433517:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485760 00000100:00100000:0.0:1788744415.433582:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788744415.433592:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744415.433858:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485760:12345-0@lo:502:mount.lustre.0 Request processed in 266us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.433867:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788744415.433946:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788744415.434481:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788744415.434546:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788744415.434702:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788744415.434743:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788744415.434781:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788744415.434835:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788744415.434889:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788744415.434925:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788744415.434970:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744415.435039:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744415.435233:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068485888 00000100:00100000:0.0:1788744415.435243:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068485888 00000100:00100000:0.0:1788744415.435400:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788744415.435411:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744415.435494:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1c1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788744415.435664:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068485888:12345-0@lo:502:mount.lustre.0 Request processed in 253us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.435674:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788744415.435728:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068485888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744415.435842:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788744415.435858:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788744415.437486:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744415.437501:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.437504:0:15013:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788744415.437512:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9409c214b000 00000020:00000080:0.0:1788744415.437529:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744415.437538:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744415.437540:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.437541:0:15013:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788744415.437544:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744415.437644:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.437647:0:15013:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788744415.437652:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9409c214b000 00000020:00000080:0.0:1788744415.437654:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744415.437782:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744415.437787:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.437788:0:15013:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788744415.437792:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744415.437794:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.437795:0:15013:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788744415.437799:0:15013:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9409c214b000 00000020:00000080:0.0:1788744415.437801:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788744415.444196:0:15013:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744415.444219:0:15013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744415.444235:0:15013:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788744415.444240:0:15013:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788744415.451243:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788744415.451307:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744415.451350:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451366:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744415.451474:0:14995:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744415.451477:0:14995:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9409c214b000 10000000:01000000:2.0:1788744415.451480:0:14995:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9409c214b000 10000000:01000000:2.0:1788744415.451483:0:14995:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744415.451490:0:14995:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9409c214b000 from 1 10000000:01000000:2.0:1788744415.451493:0:14995:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744415.451538:0:14995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451586:0:14995:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451600:0:14995:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744415.451627:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744415.451718:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.451762:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486016 00000100:00100000:2.0:1788744415.451770:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486016 00000100:00100000:2.0:1788744415.451820:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744415.451829:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068486016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744415.451843:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744415.451858:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af7389000/0x7cd2bfd5e1b9579c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95795 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451882:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389000/0x7cd2bfd5e1b9579c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95795 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451892:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af7389000/0x7cd2bfd5e1b9579c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95795 expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.451901:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af7389000, rc 0) 00000100:00100000:2.0:1788744415.451937:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486016:12345-0@lo:101:mount.lustre.0 Request processed in 109us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744415.451943:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788744415.451995:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744415.452029:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744415.452044:0:14995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9579c expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.452052:0:14995:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b9579c expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744415.452774:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788744415.453163:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744415.453432:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788744415.453474:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788744415.453521:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788744415.453601:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788744415.453640:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788744415.453691:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788744415.453727:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788744415.453761:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788744415.453811:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788744415.453848:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788744415.453883:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788744415.453932:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788744415.453969:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788744415.454002:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788744415.459865:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788744415.459929:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788744415.459955:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788744415.459999:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788744415.460058:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788744415.460110:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788744415.460160:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788744415.460195:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788744415.461419:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788744415.461618:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788744415.461662:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788744415.461698:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788744415.461751:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788744415.461787:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788744415.461888:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788744415.461896:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788744415.462051:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744415.462149:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.462218:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744415.462454:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486144 00000100:00100000:0.0:1788744415.462465:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486144 00000100:00100000:0.0:1788744415.462544:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788744415.462587:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744415.462890:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486144:12345-0@lo:501:mount.lustre.0 Request processed in 306us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744415.462898:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788744415.464946:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744415.465025:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744415.465119:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.465168:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.465462:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486272 00000100:00100000:3.0:1788744415.465473:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486272 00000100:00100000:3.0:1788744415.465542:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788744415.465576:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744415.465823:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486272:12345-0@lo:503:mount.lustre.0 Request processed in 250us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.465831:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788744415.465978:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744415.470843:0:14995:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744415.470943:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744415.471026:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.471068:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.471267:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486400 00000100:00100000:3.0:1788744415.471275:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486400 00000100:00100000:3.0:1788744415.471326:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788744415.471448:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788744415.471715:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486400:12345-0@lo:502:mount.lustre.0 Request processed in 381us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.471724:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788744415.474157:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744415.474654:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788744415.474717:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788744415.474763:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788744415.474814:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788744415.474852:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788744415.474902:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788744415.474939:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788744415.474986:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788744415.475034:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788744415.475072:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788744415.477498:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788744415.479025:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788744415.479088:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788744415.479124:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788744415.479176:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788744415.479211:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788744415.481498:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788744415.482473:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788744415.482569:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788744415.482608:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788744415.482657:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788744415.482695:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788744415.482732:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788744415.482774:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788744415.482810:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788744415.482844:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788744415.482905:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788744415.482938:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788744415.482967:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788744415.483022:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788744415.483057:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788744415.483103:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788744415.483138:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788744415.484929:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788744415.485055:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788744415.485146:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788744415.485186:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788744415.485218:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788744415.485283:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788744415.485322:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788744415.485398:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744415.485484:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.485536:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744415.488034:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486528 00000100:00100000:1.0:1788744415.488052:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486528 00000100:00100000:1.0:1788744415.488117:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788744415.488129:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744415.488454:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486528:12345-0@lo:502:mount.lustre.0 Request processed in 326us (2968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.488462:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788744415.488611:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744415.488727:0:14995:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788744415.488746:0:14995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788744415.490003:0:15018:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788744415.490025:0:15018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff940ad0cecd40) 00000020:00000080:1.0:1788744415.490048:0:15018:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788744415.490141:0:15018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9409c214b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788744415.490146:0:15018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9409c214b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788744415.490148:0:15018:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9409c214b000 3 00010000:00080000:1.0:1788744415.490188:0:15018:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9409c2486000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.156@tcp at head 00010000:00010000:1.0:1788744415.491884:0:15018:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788744415.493971:0:15018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788744415.494019:0:15018:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788744415.494039:0:15018:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7cd2bfd5e1b957aa 00000100:00080000:1.0:1788744415.494057:0:15018:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788744415.494096:0:15018:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9409c2486000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744415.494156:0:15018:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b71180 x1875634068486656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744415.494213:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068486656:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788744415.494305:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.496372:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486656 00000100:00100000:1.0:1788744415.496389:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486656 00000100:00100000:1.0:1788744415.499242:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744415.499256:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875634068486656:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788744415.499293:0:14311:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788744415.499354:0:14311:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7cd2bfd5e1b957b1 00000004:00100000:1.0:1788744415.499377:0:14311:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788744415.499415:0:14311:0:(import.c:65:import_set_state_nolock()) ffff9409c2480000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744415.499695:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875634068486656:12345-0@lo:38:llog_process_th.0 Request processed in 438us (5388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.499704:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788744415.499752:0:15018:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788744415.499786:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744415.499791:0:1343:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788744415.499794:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744415.499798:0:1343:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788744415.499873:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068486784:0@lo:400:kworker.0 00000100:00100000:1.0:1788744415.499914:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.499977:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486784 00000100:00100000:1.0:1788744415.499987:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486784 00000100:00100000:1.0:1788744415.500027:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744415.500034:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068486784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744415.500089:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068486784:12345-0@lo:400:kworker.0 Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.500096:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788744415.500135:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff940b00b72300 x1875634068486784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744415.500151:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068486784:0@lo:400:kworker.0 00010000:00080000:0.0:1788744415.503472:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff940b00b71180 x1875634068486656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744415.503490:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744415.503516:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788744415.503527:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744415.503534:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744415.503537:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9409c2486000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744415.503544:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875634068486656:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788744415.503854:0:15018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788744415.504008:0:14995:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788744415.504035:0:14995:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744415.504161:0:14995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9579c expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.504173:0:14995:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7389c00/0x7cd2bfd5e1b95795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9579c expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744415.504231:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744415.504233:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744415.504235:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744415.504236:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744415.504238:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744415.504239:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744415.504240:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744415.504242:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744415.504243:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744415.504248:0:14995:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788744415.504250:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744415.504251:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744415.504252:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744415.504253:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744415.504254:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744415.504256:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744415.504257:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744415.504258:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744415.504259:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744415.504301:0:14995:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788744415.504321:0:14995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744415.504393:0:14995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744415.504443:0:14995:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad31cc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744415.504503:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068486912 00000100:00100000:0.0:1788744415.504520:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068486912 00000100:00100000:0.0:1788744415.504588:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788744415.504598:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14995:x1875634068486912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788744415.504624:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788744415.504640:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788744415.550498:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788744415.550620:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788744415.550931:0:14327:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788744415.550938:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788744415.550964:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.550986:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 16 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.550995:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.551054:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 16 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.551085:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 16 pid: 14306 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744415.551102:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068487040:0@lo:104: 00000100:00100000:1.0:1788744415.551191:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.551258:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae0760600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744415.551332:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487040 00000100:00100000:3.0:1788744415.551348:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487040 00000100:00100000:3.0:1788744415.555149:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744415.555181:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068487040:12345-0@lo:104: 00010000:00010000:3.0:1788744415.555214:0:14295:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744415.555358:0:14295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744415.555365:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068487040:12345-0@lo:104: Request processed in 199us (4173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744415.555373:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788744415.557687:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744415.557705:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.557717:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2a00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:1.0:1788744415.557722:0:14299:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.557732:0:14299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788744415.557739:0:14299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744415.557744:0:14299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788744415.558087:0:14299:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.558094:0:14299:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788744415.560315:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068487040:0@lo:104: 00010000:00010000:2.0:1788744415.560350:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.560652:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.560677:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af73d2a00/0x7cd2bfd5e1b9571e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95725 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.560700:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744415.560703:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744415.560705:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744415.560725:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788744415.560741:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068487168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788744415.560807:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744415.560864:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487168 00000100:00100000:1.0:1788744415.560871:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487168 00010000:00010000:1.0:1788744415.560906:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 17 pid: 14306 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744415.560951:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744415.560962:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:3313:x1875634068487168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788744415.562336:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744415.562353:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 17 pid: 14306 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562371:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 17 pid: 14306 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562391:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d3a00/0x7cd2bfd5e1b95725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9571e expref: 17 pid: 14306 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562409:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562437:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788744415.562458:0:14298:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011521764s 00010000:00010000:1.0:1788744415.562464:0:14298:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562472:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562479:0:14298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562486:0:14298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562493:0:14298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744415.562497:0:14298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562504:0:14298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562521:0:14298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744415.562531:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744415.562614:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3313:x1875634068487168:12345-0@lo:103:ldlm_bl.0 Request processed in 1653us (1807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.562623:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788744415.562683:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3313:1875634068487168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788744415.562776:0:14327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.562784:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744415.562790:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2c00/0x7cd2bfd5e1b957b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744415.571657:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14995:x1875634068486912:12345-0@lo:253:mount.lustre.0 Request processed in 67049us (67252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744415.571679:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788744415.571817:0:14995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14995:1875634068486912:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788744415.571835:0:14995:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788744415.571839:0:14995:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788744415.571840:0:14995:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788744415.571842:0:14995:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744415.571843:0:14995:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744415.571844:0:14995:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744415.571845:0:14995:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744415.571847:0:14995:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744415.571850:0:14995:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744415.571852:0:14995:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788744415.571874:0:14995:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788744415.579046:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744415.580329:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788744415.580531:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744415.580724:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788744415.580872:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744415.581340:0:14995:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788744415.583067:0:14995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788744415.736486:0:14995:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788744415.736498:0:14995:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788744415.736813:0:14995:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788744415.736907:0:14995:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788744415.736926:0:14995:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788744415.736956:0:14995:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788744416.284728:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744417.306865:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788744417.498660:0:14308:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788744417.498671:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac2d3a000 from 7 10000000:01000000:3.0:1788744417.498678:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788744417.498725:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.498747:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.498760:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744417.498787:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068487296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788744417.498871:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744417.498931:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7f98b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744417.498988:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487296 00000100:00100000:0.0:1788744417.498998:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487296 00000100:00100000:0.0:1788744417.499067:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788744417.499078:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+15:14308:x1875634068487296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788744417.499090:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744417.499104:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b957bf expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.499127:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.499136:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 16 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744417.499151:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77600, rc 0) 00000100:00100000:0.0:1788744417.499189:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14308:x1875634068487296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744417.499195:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788744417.499859:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068487296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744417.499884:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.499893:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744417.499977:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068487424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788744417.500023:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744417.500059:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7f98b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744417.500128:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487424 00000100:00100000:0.0:1788744417.500135:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487424 00000100:00100000:0.0:1788744417.500174:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788744417.500190:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14308:x1875634068487424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788744417.500208:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788744417.500223:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788744417.500225:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788744417.500300:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14308:x1875634068487424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744417.500308:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788744417.500504:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068487424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788744417.500593:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788744417.500602:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744417.500611:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744418.331053:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744419.356186:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744420.385147:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788744420.893545:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744420.893570:0:1343:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788744420.893573:0:1343:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744420.893576:0:1343:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788744420.893614:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744420.893637:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068487552:0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.893717:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744420.893785:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487552 00000100:00100000:0.0:1788744420.893794:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487552 00000100:00100000:0.0:1788744420.893838:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744420.893848:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068487552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.893921:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068487552:12345-0@lo:400:kworker.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744420.894536:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788744420.894726:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068487552:0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.896622:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068487808:0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.896712:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744420.896751:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744420.896758:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068487680:0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.896785:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744420.896834:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487808 00000100:00100000:0.0:1788744420.896841:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487808 00000100:00100000:0.0:1788744420.896900:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487680 00000100:00100000:0.0:1788744420.896904:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487680 00000100:00100000:0.0:1788744420.896921:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744420.896931:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068487808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.896997:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068487808:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744420.897005:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788744420.897022:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744420.897027:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068487680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744420.897054:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068487680:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744420.897061:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788744420.897141:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788744420.897168:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad31e7480 x1875634068487680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744420.897203:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068487680:0@lo:400:kworker.0 00010000:00080000:0.0:1788744420.897216:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad31e5f80 x1875634068487808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744420.897226:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068487808:0@lo:400:kworker.0 00010000:00010000:3.0:1788744421.402789:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744422.429925:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788744422.748810:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788744423.192022:0:15363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788744423.451734:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744424.479984:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.506064:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744425.756280:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744410/real 1788744410] req@ffff940af73ce300 x1875634068483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744425 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744425.756319:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff940af73ce300 x1875634068483712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744425 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744425.756330:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788744410/real 1788744410] req@ffff940af73cc380 x1875634068483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744425 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744425.756341:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff940af73cc380 x1875634068483840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788744425 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788744425.756362:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940acdcd1800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744425.756441:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744425.756445:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068483712:0@lo:8:kworker.0 00000100:00080000:2.0:1788744425.756451:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744425.759896:0:14727:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744425.759903:0:14727:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788744425.759907:0:14727:0:(import.c:65:import_set_state_nolock()) ffff940acdcd1800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744425.759915:0:14727:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1788744425.759921:0:14727:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788744425.759934:0:14727:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff940acdcd1800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744425.759946:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068487936:0@lo:400:kworker.0 00000100:00100000:0.0:1788744425.759958:0:14727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad31e7480 x1875634068488064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788744425.759969:0:14727:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788744425.759972:0:14727:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788744425.759973:0:14727:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788744425.759976:0:14727:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1788744425.759978:0:14727:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788744425.759982:0:14727:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:0.0:1788744425.759992:0:14727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940ad31e4000 x1875634068488192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788744425.760041:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068488448:0@lo:400:kworker.0 00000100:00100000:0.0:1788744425.760091:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744425.760169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744425.760177:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488448 00000100:00100000:0.0:1788744425.760186:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488448 00000100:00100000:1.0:1788744425.760198:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744425.760205:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068488320:0@lo:400:kworker.0 00000100:00100000:1.0:1788744425.760227:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744425.760239:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488320 00000100:00100000:0.0:1788744425.760242:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488320 00000100:00100000:0.0:1788744425.760259:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788744425.760319:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068487936 00000100:00100000:3.0:1788744425.760324:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068487936 00000100:00100000:3.0:1788744425.760355:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744425.760370:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068487936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744425.760425:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068487936:12345-0@lo:400:kworker.0 Request processed in 56us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744425.760432:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788744425.760488:0:14311:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788744425.760496:0:14311:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1788744425.760510:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744425.760763:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068488448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744425.760808:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068488448:12345-0@lo:400:kworker.0 Request processed in 542us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.763833:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788744425.763868:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068488320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744425.764760:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068488320:12345-0@lo:400:kworker.0 Request processed in 907us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.764772:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788744425.764855:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad31e7b80 x1875634068488320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744425.764871:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068488320:0@lo:400:kworker.0 00000100:00100000:1.0:1788744425.764898:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068487936:0@lo:400:kworker.0 00010000:00080000:1.0:1788744425.765269:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad31e5880 x1875634068488448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788744425.765280:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068488448:0@lo:400:kworker.0 00000100:00080000:2.0:1788744425.767540:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788744425.767565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068483840:0@lo:8:kworker.0 00000100:00100000:2.0:1788744425.767620:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068488064:0@lo:8:kworker.0 00000100:00100000:2.0:1788744425.767724:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744425.767771:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068488192:0@lo:8:kworker.0 00000100:00100000:2.0:1788744425.767795:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744425.767891:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488064 00000100:00100000:2.0:1788744425.767899:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488064 00000100:00100000:2.0:1788744425.767926:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488192 00000100:00100000:2.0:1788744425.767929:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488192 00000100:00100000:2.0:1788744425.767941:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744425.767949:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068488064:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788744425.767982:0:14998:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788744425.768035:0:14998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b957cd 00002000:00100000:2.0:1788744425.768053:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff940ad846d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788744425.768057:0:14998:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788744425.768060:0:14998:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788744425.768520:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744425.768592:0:14998:0:(import.c:65:import_set_state_nolock()) ffff940ad8469000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744425.768661:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634068488064:12345-0@lo:8:kworker.0 Request processed in 711us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744425.768668:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744425.768689:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788744425.768693:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068488192:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788744425.768711:0:14998:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744425.768737:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068488192:12345-0@lo:8:kworker.0 Request processed in 42us (941us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788744425.768742:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788744425.768781:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940ad31e7480 x1875634068488064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788744425.768793:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788744425.768803:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788744425.768811:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788744425.768817:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788744425.768821:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940acdcd1800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788744425.770132:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788744425.770145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068488064:0@lo:8:kworker.0 00000100:00080000:2.0:1788744425.770217:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788744425.770222:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788744425.770241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068488192:0@lo:8:kworker.0 00000100:00100000:0.0:1788744425.777608:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788744425.777848:0:14334:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788744425.777892:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14334:1875634068488704:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744425.777972:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744425.778003:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d67840 going to sleep for 11 seconds 00000100:00100000:3.0:1788744425.778020:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744425.778032:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068488576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744425.778058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744425.778095:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488576 00000100:00100000:3.0:1788744425.778103:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488576 00000100:00100000:3.0:1788744425.778148:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788744425.778159:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068488576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744425.778195:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744425.778238:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068488576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744425.778251:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788744425.778269:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788744425.778302:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af73aaa00 x1875634068488576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744425.778323:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068488576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744425.781803:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488704 00000100:00100000:2.0:1788744425.781823:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488704 00000100:00100000:2.0:1788744425.781922:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744425.781934:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1875634068488704:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788744425.789776:0:14333:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788744425.790192:0:14333:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 497922641820ns, next at 0ns, rc = 0 00002000:00080000:2.0:1788744425.793974:0:14998:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788744425.793987:0:14998:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788744425.793995:0:14998:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788744425.832196:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.832210:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.832228:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1788744425.832233:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744425.832240:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.832257:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.832269:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.832276:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.832295:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.833611:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.833622:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.833634:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.833638:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.833647:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.833671:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.833679:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db647b9b/0x7cd2bfd5e1b957d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.833718:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.833720:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.833722:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744425.847265:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.847285:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847307:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1788744425.847312:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744425.847320:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847335:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847345:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847353:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847383:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788744425.847925:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.847933:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847942:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1788744425.847946:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744425.847950:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847973:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847982:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.847990:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848009:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744425.848024:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744425.848031:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848038:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.848043:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848051:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848067:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848076:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b957db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848101:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.848104:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848111:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.848114:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848122:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848132:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848139:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042808c65/0x7cd2bfd5e1b957e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848150:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.848152:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.848154:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744425.848635:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.848642:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848652:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1788744425.848661:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744425.848666:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848678:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848686:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848693:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848710:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744425.848720:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.848724:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848731:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.848734:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848742:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848752:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848770:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000673e5ee/0x7cd2bfd5e1b957e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.848785:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.848787:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.848788:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744425.849203:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.849210:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849218:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=497s v=(0 0) 00010000:00010000:2.0:1788744425.849222:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744425.849226:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849234:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849242:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849249:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849267:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744425.849275:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.849284:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849292:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.849296:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849304:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849315:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849322:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000417c65bc/0x7cd2bfd5e1b957f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.849338:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.849340:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.849341:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.849768:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.863174:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.863191:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863209:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.863214:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.863220:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863243:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863255:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863263:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863294:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.863375:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.863385:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.863394:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fce00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.863398:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.863407:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.863426:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.863434:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014cf6bbe/0x7cd2bfd5e1b957f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.863453:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.863456:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.863457:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.863912:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.863920:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863931:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.863934:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.863938:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863961:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863970:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863978:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.863995:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744425.864417:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.864423:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.864433:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.864436:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.864439:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.864449:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.864458:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.864475:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.864497:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788744425.864529:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744425.864535:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864579:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fda00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.864583:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864591:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864604:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864612:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001966f9f6/0x7cd2bfd5e1b957fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864629:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.864632:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864639:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.864642:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864649:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864659:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864672:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b95805 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.864686:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.864687:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.864689:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.865479:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.865487:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.865497:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.865501:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.865505:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.865515:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.865522:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.865529:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.865572:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.865646:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.865652:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.865659:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.865663:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.865671:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.865683:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.865690:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b9580c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.865706:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.865708:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.865710:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.865817:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.866016:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.866021:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866035:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.866038:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.866042:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866050:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866058:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866065:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866085:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788744425.866241:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788744425.866338:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.866343:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.866350:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.866354:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.866363:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.866374:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.866382:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b95813 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.866397:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.866398:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.866400:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.866666:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.866674:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866683:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.866686:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.866691:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866700:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866714:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866721:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.866737:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.867118:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.867124:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867133:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.867136:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867166:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744425.867170:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.867175:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867180:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867183:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.867186:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744425.867188:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b9581a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867191:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867199:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867202:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867204:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867205:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744425.867208:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867214:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867245:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.867295:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.867300:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867308:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.867311:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867319:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867330:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867347:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b95821 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867361:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867362:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867364:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744425.867681:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744425.867687:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867696:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1788744425.867699:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744425.867704:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867714:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867723:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867730:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744425.867753:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.867916:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.867923:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867931:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.867935:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867944:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867955:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867962:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95828 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.867977:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867979:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.867980:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788744425.872004:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788744425.872018:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.874186:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1788744425.874317:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744425.874327:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.874350:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.874363:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.874371:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.874397:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744425.875190:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.875201:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.875212:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.875218:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.875243:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788744425.875258:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744425.875264:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.875267:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.875287:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b9582f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.875290:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1788744425.875298:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744425.875304:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.875316:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.875320:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.875323:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.875332:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.875343:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.875352:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.875375:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744425.875432:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744425.875439:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.875447:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744425.875450:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.875458:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.875482:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.875490:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95836 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.875517:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.875519:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.875521:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744425.876149:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.876166:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876188:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.876192:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.876197:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876207:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876215:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876222:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876241:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744425.876713:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.876720:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876729:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.876732:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.876736:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876746:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876765:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876773:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.876792:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788744425.877188:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.877194:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877203:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.877207:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.877211:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877222:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877230:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877239:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877257:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788744425.877404:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744425.877412:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877421:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.877425:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877435:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877451:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877459:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a667cda7/0x7cd2bfd5e1b9583d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877483:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744425.877499:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877506:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.877509:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877516:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877539:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877546:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf3fefa1/0x7cd2bfd5e1b95844 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877581:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.877584:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877590:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.877594:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877614:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877627:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877635:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000137c4336/0x7cd2bfd5e1b9584b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877653:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.877656:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.877658:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744425.877707:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.877713:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877723:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.877726:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.877730:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877739:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877748:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877755:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.877776:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.877848:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.877853:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877863:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.877867:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877886:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877899:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877917:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb03a179/0x7cd2bfd5e1b95852 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.877936:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.877940:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.877942:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744425.878193:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.878199:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.878206:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.878216:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.878221:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.878230:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.878237:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.878243:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.878264:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744425.878629:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.878636:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.878644:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.878649:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.878657:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.878670:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.878678:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bdf5a27/0x7cd2bfd5e1b95859 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.878693:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.878695:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.878697:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.879120:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744425.882020:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.882247:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.882267:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.882272:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.882280:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.882300:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.882314:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.882339:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.882416:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744425.883166:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.883175:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.883185:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.883189:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.883193:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.883204:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.883213:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.883220:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884087:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744425.884099:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884111:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.884116:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884127:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884150:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884229:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9c52025/0x7cd2bfd5e1b95860 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884259:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.884264:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884270:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.884274:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884281:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884310:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.884318:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.884320:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.884322:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.884430:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788744425.884437:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb07b9e9/0x7cd2bfd5e1b95867 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.886257:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788744425.887207:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.887217:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.887235:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.887240:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.887246:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.887261:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.887271:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.887279:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.887348:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788744425.888245:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.888253:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.888266:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.888269:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.888281:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.888292:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.888300:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.888307:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888624:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744425.888633:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888643:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.888648:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888658:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888677:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888685:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000badebf88/0x7cd2bfd5e1b9586e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888705:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.888708:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888727:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.888731:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888738:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888747:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.888753:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.888754:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.888756:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.888837:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788744425.888843:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000840eb00e/0x7cd2bfd5e1b95875 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744425.889747:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.889756:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.889770:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.889774:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.889780:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.889793:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.889814:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.889822:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.889884:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.889893:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.889901:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.889905:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.889921:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.889935:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.889951:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.889952:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.889954:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.890166:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788744425.890172:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6378151/0x7cd2bfd5e1b9587c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744425.891248:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.891257:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.891269:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.891273:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.891277:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.891289:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.891298:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.891317:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.891443:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744425.891452:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.891460:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744425.891463:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.891489:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.891515:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744425.891532:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.891533:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744425.891535:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.892129:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788744425.892138:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc66e08f/0x7cd2bfd5e1b95883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788744425.892977:0:14998:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788744425.892987:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.893000:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=498s v=(0 0) 00010000:00010000:1.0:1788744425.893005:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788744425.893010:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.893213:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.893224:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744425.893232:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.893306:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744425.893314:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.893322:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744425.893327:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.893335:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.893350:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744425.893358:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.893360:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744425.893362:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744425.893435:0:14998:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788744425.893440:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f639c51f/0x7cd2bfd5e1b9588a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788744425.893738:0:14998:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788744425.893842:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14334:x1875634068488704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111906us (115865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744425.893856:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788744425.894284:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744425.895457:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14334:1875634068488704:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744425.895479:0:14334:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1788744425.895542:0:14334:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14334:1875634068488832:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788744425.895618:0:14334:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744425.895681:0:14334:0:(client.c:2716:ptlrpc_set_wait()) set ffff940b00945e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788744425.895959:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488832 00000100:00100000:1.0:1788744425.895967:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488832 00000100:00100000:1.0:1788744425.896133:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788744425.896144:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14334:x1875634068488832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788744425.896192:0:14999:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788744425.911502:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14334:x1875634068488832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15338us (15862us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788744425.911516:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744425.911636:0:14334:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14334:1875634068488832:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788744425.911656:0:14334:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:1.0:1788744426.160937:0:6708:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788744426.160988:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788744426.526694:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744427.547667:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744428.571164:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744429.594732:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744430.620165:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744431.130730:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788744431.130765:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068488960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744431.130882:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744431.130992:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068488960 00000100:00100000:3.0:1788744431.131002:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068488960 00000100:00100000:3.0:1788744431.131076:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788744431.131088:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068488960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744431.131134:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744431.131198:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068488960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744431.131206:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788744431.131231:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788744431.131325:0:14727:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788744431.131330:0:14727:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788744431.131335:0:14727:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788744431.131342:0:14727:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:1.0:1788744431.131347:0:14727:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788744431.131357:0:14727:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:1.0:1788744431.131384:0:14727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940b00b71880 x1875634068489216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788744431.131439:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744431.131465:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068489088:0@lo:400:kworker.0 00000100:00100000:1.0:1788744431.131508:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744431.131664:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068489216:0@lo:8:kworker.0 00000100:00100000:2.0:1788744431.131706:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744431.131808:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788744431.131837:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068488960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788744431.132325:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068489472:0@lo:400:kworker.0 00000100:00100000:1.0:1788744431.132374:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744431.132398:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788744431.132405:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068489344:0@lo:400:kworker.0 00000100:00100000:1.0:1788744431.132429:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744431.132462:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489088 00000100:00100000:1.0:1788744431.132470:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489088 00000100:00100000:1.0:1788744431.132516:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744431.132526:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068489088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744431.132610:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068489088:12345-0@lo:400:kworker.0 Request processed in 84us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744431.132618:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788744431.132659:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489216 00000100:00100000:1.0:1788744431.132663:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489216 00000100:00100000:1.0:1788744431.132687:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788744431.132693:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068489216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788744431.132719:0:14998:0:(ldlm_lib.c:1202:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788744431.135997:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489472 00000100:00100000:2.0:1788744431.136022:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489472 00000100:00100000:2.0:1788744431.136133:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489344 00000100:00100000:2.0:1788744431.136137:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489344 00000100:00100000:2.0:1788744431.136179:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744431.136193:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068489472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744431.136339:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068489472:12345-0@lo:400:kworker.0 Request processed in 149us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744431.136348:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788744431.136372:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788744431.136379:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068489344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744431.136409:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068489344:12345-0@lo:400:kworker.0 Request processed in 31us (3979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744431.136415:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788744431.136499:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744431.146700:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068489088:0@lo:400:kworker.0 00010000:00080000:0.0:1788744431.148630:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940b00b72a00 x1875634068489344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744431.148653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068489344:0@lo:400:kworker.0 00010000:00080000:0.0:1788744431.148671:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940b00b73b80 x1875634068489472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744447 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744431.148679:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068489472:0@lo:400:kworker.0 00000100:00100000:1.0:1788744431.155128:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068489216:12345-0@lo:8:kworker.0 Request processed in 21502us (22488us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788744431.155147:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788744431.155212:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744431.155223:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788744431.155228:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068489216:0@lo:8:kworker.0 00010000:00010000:0.0:1788744431.643117:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788744431.879263:0:15716:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788744431.879269:0:15716:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788744431.879432:0:15716:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff940ad8468800 00000020:01000004:2.0:1788744431.879450:0:15716:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788744431.879463:0:15716:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788744431.879478:0:15716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff940ad1cd19c0) 00000020:00000080:2.0:1788744431.879498:0:15716:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788744431.914134:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788744431.914817:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788744431.916780:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788744431.917626:0:15716:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788744431.918025:0:15716:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788744431.920689:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:3.0:1788744431.920812:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 435: rc = 0 00100000:10000000:3.0:1788744431.920935:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 435: rc = 0 00100000:10000000:3.0:1788744431.922167:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 352: rc = 0 00100000:10000000:3.0:1788744431.923097:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 352: rc = 0 00100000:10000000:3.0:1788744431.923777:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 352: rc = 0 00100000:10000000:3.0:1788744431.924158:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 352: rc = 0 00100000:10000000:3.0:1788744431.924697:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 352: rc = 0 00100000:10000000:3.0:1788744431.925057:0:15716:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 352: rc = 0 00000020:00000080:3.0:1788744431.926038:0:15716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788744431.926051:0:15716:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788744431.926060:0:15716:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7cd2bfd5e1b95898 00000020:01000004:3.0:1788744431.926067:0:15716:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788744431.926086:0:15716:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788744431.926089:0:15716:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788744431.926095:0:15716:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788744431.926115:0:15716:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788744431.926118:0:15716:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788744431.947179:0:15716:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788744431.947344:0:15716:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.156@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788744431.947349:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788744431.947351:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744431.947352:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744431.947358:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744431.947360:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744431.947361:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744431.947362:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744431.947364:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744431.947365:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744431.947369:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788744431.947371:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788744431.947373:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744431.947374:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744431.947375:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744431.947376:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744431.947377:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744431.947378:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744431.947379:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744431.947379:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788744431.947467:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788744431.947488:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489600:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788744431.947656:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744431.947753:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788744431.947809:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489600 00000100:00100000:3.0:1788744431.947819:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489600 00000100:00100000:3.0:1788744431.948009:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788744431.948019:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:15716:x1875634068489600:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788744431.948046:0:14306:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788744431.948049:0:14306:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788744431.948052:0:14306:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788744431.958837:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:15716:x1875634068489600:12345-0@lo:253:mount.lustre.0 Request processed in 10808us (11168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744431.958865:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788744431.959659:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489600:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788744431.959679:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788744431.959682:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788744431.959684:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788744431.959686:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788744431.959687:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788744431.959688:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788744431.959690:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788744431.959691:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788744431.959693:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788744431.959694:0:15716:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788744431.959722:0:15716:0:(tgt_mount.c:101:server_register_mount()) register mount ffff940ad8468800 from lustre-OST0001 10000000:01000000:1.0:1788744431.959768:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788744431.959771:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788744431.959781:0:15716:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9409c11e3380 local copy 00010000:00010000:1.0:1788744431.959795:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744431.960213:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744431.960493:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744431.960873:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744431.961077:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489728 00000100:00100000:2.0:1788744431.961090:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489728 00000100:00100000:3.0:1788744431.961275:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788744431.961500:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:15716:x1875634068489728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744431.962041:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:15716:x1875634068489728:12345-0@lo:501:mount.lustre.0 Request processed in 545us (1546us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788744431.962050:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788744431.962160:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788744431.962185:0:15716:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788744431.962404:0:15716:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788744431.962415:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744431.962427:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940ac13fc600/0x7cd2bfd5e1b95645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b9564c expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744431.962456:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff940ad8468800 10000000:01000000:2.0:1788744431.962461:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788744431.962467:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788744431.962470:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744431.962475:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788744431.962479:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788744431.962516:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744431.962524:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744431.962534:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744431.962580:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744431.962621:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744431.967840:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744431.968055:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489856 00000100:00100000:1.0:1788744431.968065:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489856 00000100:00100000:1.0:1788744431.968119:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788744431.968130:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:15716:x1875634068489856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744431.968149:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744431.968171:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3800/0x7cd2bfd5e1b958a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b9589f expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.968203:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3800/0x7cd2bfd5e1b958a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9589f expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.968214:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3800/0x7cd2bfd5e1b958a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9589f expref: 17 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744431.968234:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3800, rc 0) 00000100:00100000:1.0:1788744431.968770:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068489856:12345-0@lo:101:mount.lustre.0 Request processed in 629us (6137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744431.968778:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788744431.969029:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744431.969048:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958a6 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744431.969058:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b958a6 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744431.970349:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788744431.972810:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744431.973516:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788744431.973741:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788744431.973791:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788744431.973840:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788744431.974157:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788744431.974196:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788744431.974516:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788744431.974526:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788744431.974749:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744431.975016:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744431.975138:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744431.977069:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068489984 00000100:00100000:1.0:1788744431.977085:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068489984 00000100:00100000:2.0:1788744431.977277:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788744431.977481:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068489984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744431.978611:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068489984:12345-0@lo:501:mount.lustre.0 Request processed in 1131us (3592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744431.978622:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788744431.978727:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068489984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788744431.978794:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744431.978861:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744431.979107:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744431.979199:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490112 00000100:00100000:3.0:1788744431.979207:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490112 00000100:00100000:3.0:1788744431.979256:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788744431.979265:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788744431.979811:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490112:12345-0@lo:503:mount.lustre.0 Request processed in 545us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744431.979819:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788744431.980088:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490112:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744431.981715:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744431.981832:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744431.982019:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744431.982075:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744431.982169:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490240 00000100:00100000:2.0:1788744431.982177:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490240 00000100:00100000:2.0:1788744431.982222:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788744431.982233:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744431.982490:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490240:12345-0@lo:502:mount.lustre.0 Request processed in 259us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744431.982498:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788744431.982990:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744431.983268:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788744431.983471:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788744431.983507:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788744431.983709:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788744431.983748:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788744431.983792:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788744431.983834:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788744431.983875:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788744431.984455:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788744431.984502:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744431.984609:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744431.984654:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744431.984837:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490368 00000100:00100000:2.0:1788744431.984853:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490368 00000100:00100000:2.0:1788744431.985008:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788744431.985019:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744431.985226:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490368:12345-0@lo:502:mount.lustre.0 Request processed in 202us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744431.985288:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744431.985375:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788744431.985625:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000100:00100000:2.0:1788744431.987037:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000020:01000000:0.0:1788744431.987575:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788744431.987584:0:15717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788744431.987591:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744431.987594:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788744431.987601:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788744431.987621:0:15717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff940ac60a3380) 00000020:00000080:0.0:1788744431.987649:0:15717:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788744431.987656:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788744431.987736:0:15717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940ad8468800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788744431.987746:0:15717:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788744431.987754:0:15717:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7cd2bfd5e1b958b4 00010000:00010000:0.0:1788744431.994081:0:15717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788744431.995090:0:15717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788744431.998150:0:15717:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788744432.000695:0:15717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788744432.000711:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744432.000718:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744432.000720:0:15717:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788744432.000723:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744432.000728:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744432.000730:0:15717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788744432.000733:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788744432.000735:0:15717:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788744432.000738:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744432.000740:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744432.000742:0:15717:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788744432.000744:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788744432.000746:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744432.000748:0:15717:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788744432.000751:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788744432.000834:0:15717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788744432.000838:0:15717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788744432.000839:0:15717:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788744432.000843:0:15717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788744432.001188:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788744432.001232:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788744432.001257:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958a6 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.001271:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7389200/0x7cd2bfd5e1b9589f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958a6 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744432.001288:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ad8468800 from 1 10000000:01000000:2.0:1788744432.001292:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788744432.001335:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.001343:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.001354:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744432.001406:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490496:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744432.001483:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.001530:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2594cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744432.002689:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490496 00000100:00100000:0.0:1788744432.002703:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490496 00000100:00100000:0.0:1788744432.002812:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788744432.002823:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:15716:x1875634068490496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788744432.002838:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744432.002863:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b958bb expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744432.002891:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744432.002930:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744432.002940:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77e00, rc 0) 00000100:00100000:0.0:1788744432.003021:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490496:12345-0@lo:101:mount.lustre.0 Request processed in 200us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744432.003027:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788744432.003115:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744432.003135:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744432.003144:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788744432.003738:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788744432.004234:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788744432.004461:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788744432.004507:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788744432.004619:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788744432.004627:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788744432.004705:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744432.004778:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744432.006203:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744432.011613:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490624 00000100:00100000:2.0:1788744432.011634:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490624 00000100:00100000:2.0:1788744432.011704:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788744432.011718:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744432.012101:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490624:12345-0@lo:501:mount.lustre.0 Request processed in 384us (7320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.012108:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788744432.012529:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788744432.012618:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788744432.012672:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744432.012706:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae5ff06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788744432.013380:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490752 00000100:00100000:0.0:1788744432.013389:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490752 00000100:00100000:0.0:1788744432.013517:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744432.013526:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490752:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788744432.014007:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490752:12345-0@lo:503:mount.lustre.0 Request processed in 480us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744432.014017:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788744432.014071:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788744432.015227:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788744432.017717:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744432.017839:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744432.017880:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad25a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788744432.018021:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068490880 00000100:00100000:2.0:1788744432.018029:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068490880 00000100:00100000:2.0:1788744432.018124:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788744432.018135:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744432.018674:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068490880:12345-0@lo:502:mount.lustre.0 Request processed in 539us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.018681:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788744432.020256:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068490880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744432.020648:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788744432.020722:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788744432.020788:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788744432.020863:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788744432.020900:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788744432.020984:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788744432.021021:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788744432.021058:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788744432.021107:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788744432.021186:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744432.028586:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad305f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744432.029391:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491008 00000100:00100000:1.0:1788744432.029406:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491008 00000100:00100000:1.0:1788744432.029518:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788744432.029527:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068491008:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744432.032196:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068491008:12345-0@lo:502:mount.lustre.0 Request processed in 2661us (11001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744432.032209:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788744432.033536:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788744432.034137:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788744432.034157:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788744432.036198:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744432.036214:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.036217:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788744432.036225:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ad8468800 00000020:00000080:2.0:1788744432.036228:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744432.036237:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744432.036240:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.036241:0:15721:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788744432.036244:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744432.036247:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.036319:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788744432.036328:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff940ad8468800 00000020:00000080:2.0:1788744432.036330:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744432.036433:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744432.036437:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.036438:0:15721:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788744432.036441:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788744432.036444:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.036446:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788744432.036449:0:15721:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff940ad8468800 00000020:00000080:2.0:1788744432.036451:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788744432.039615:0:15721:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788744432.039627:0:15721:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788744432.039629:0:15721:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788744432.039634:0:15721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788744432.040794:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788744432.040835:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744432.040864:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.040878:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744432.040940:0:15716:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788744432.040943:0:15716:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff940ad8468800 10000000:01000000:2.0:1788744432.040946:0:15716:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff940ad8468800 10000000:01000000:2.0:1788744432.040951:0:15716:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788744432.040957:0:15716:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff940ad8468800 from 1 10000000:01000000:2.0:1788744432.040960:0:15716:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788744432.040997:0:15716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.041006:0:15716:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.041034:0:15716:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744432.041075:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788744432.041147:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.041191:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744432.041588:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491136 00000100:00100000:1.0:1788744432.041596:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491136 00000100:00100000:1.0:1788744432.041647:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788744432.041656:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068491136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788744432.041670:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744432.041690:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3c00/0x7cd2bfd5e1b958d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b958c9 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744432.041716:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3c00/0x7cd2bfd5e1b958d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958c9 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744432.041726:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3c00/0x7cd2bfd5e1b958d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958c9 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744432.041735:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3c00, rc 0) 00000100:00100000:1.0:1788744432.041881:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491136:12345-0@lo:101:mount.lustre.0 Request processed in 215us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744432.041889:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788744432.042111:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788744432.042126:0:15716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958d0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.042135:0:15716:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b958d0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744432.045353:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788744432.053654:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744432.054070:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788744432.054115:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788744432.054147:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788744432.054192:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788744432.054230:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788744432.054279:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788744432.054316:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788744432.054352:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788744432.054404:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788744432.054439:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788744432.054471:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788744432.054517:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788744432.054605:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788744432.054639:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788744432.054704:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788744432.054742:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788744432.054789:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788744432.054839:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788744432.054876:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788744432.054912:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788744432.054965:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788744432.055002:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788744432.055035:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788744432.055085:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788744432.055124:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788744432.055154:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788744432.055195:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788744432.055232:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788744432.055288:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788744432.055362:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788744432.055401:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788744432.055436:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788744432.055466:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788744432.055512:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788744432.055545:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788744432.055633:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788744432.055665:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788744432.055765:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788744432.055774:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788744432.055900:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744432.055999:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.056054:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d23000 going to sleep for 11 seconds 00000100:00100000:3.0:1788744432.057359:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491264 00000100:00100000:3.0:1788744432.057378:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491264 00000100:00100000:3.0:1788744432.057460:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788744432.057472:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491264:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788744432.057886:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491264:12345-0@lo:501:mount.lustre.0 Request processed in 415us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744432.057894:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788744432.062019:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788744432.062115:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491392:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744432.062225:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.062279:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491392 00000100:00100000:2.0:1788744432.062288:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491392 00000100:00100000:2.0:1788744432.062355:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744432.062366:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491392:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788744432.062805:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491392:12345-0@lo:503:mount.lustre.0 Request processed in 439us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.062813:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788744432.062884:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d23000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744432.062901:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491392:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788744432.063499:0:15716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788744432.063631:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491520:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744432.063701:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.063726:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d23000 going to sleep for 11 seconds 00000100:00100000:1.0:1788744432.066890:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491520 00000100:00100000:1.0:1788744432.066923:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491520 00000100:00100000:1.0:1788744432.066988:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788744432.066999:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788744432.067403:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491520:12345-0@lo:502:mount.lustre.0 Request processed in 405us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744432.067411:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788744432.068127:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491520:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744432.068423:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788744432.068485:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788744432.068521:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788744432.069713:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788744432.069775:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788744432.069829:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788744432.069862:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788744432.073665:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788744432.073835:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788744432.073877:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788744432.073929:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788744432.074000:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788744432.074051:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788744432.074082:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788744432.074129:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788744432.074165:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788744432.074199:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788744432.074243:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788744432.074275:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788744432.074323:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788744432.074368:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788744432.074399:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788744432.074426:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788744432.074469:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788744432.074505:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788744432.074537:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788744432.074630:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788744432.074667:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788744432.074702:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788744432.074745:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788744432.074800:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788744432.074831:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788744432.074861:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788744432.074906:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788744432.074940:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788744432.075005:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788744432.075036:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788744432.075063:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788744432.075104:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788744432.075137:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788744432.075194:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744432.075292:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.075379:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491648 00000100:00100000:2.0:1788744432.075387:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491648 00000100:00100000:2.0:1788744432.075447:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744432.075456:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788744432.075718:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491648:12345-0@lo:502:mount.lustre.0 Request processed in 262us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.075728:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788744432.075815:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d23000 going to sleep for 11 seconds 00000100:00100000:2.0:1788744432.075840:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788744432.075924:0:15716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788744432.075936:0:15716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788744432.089092:0:15726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788744432.089112:0:15726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff940ac60a4d40) 00000020:00000080:0.0:1788744432.089135:0:15726:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788744432.089883:0:15726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff940ad8468800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744432.089889:0:15726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff940ad8468800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788744432.089892:0:15726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff940ad8468800 3 00010000:00080000:3.0:1788744432.090895:0:15726:0:(ldlm_lib.c:103:import_set_conn()) imp ffff940ad2f12000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.156@tcp at head 00010000:00010000:2.0:1788744432.099189:0:15726:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788744432.099448:0:15726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788744432.099487:0:15726:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788744432.099501:0:15726:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7cd2bfd5e1b958de 00000100:00080000:2.0:1788744432.099511:0:15726:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788744432.099524:0:15726:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff940ad2f12000 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744432.099590:0:15726:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73cf800 x1875634068491776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788744432.099621:0:15726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788744432.100533:0:15726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788744432.102461:0:15716:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788744432.102504:0:15716:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788744432.102526:0:15716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958d0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.102539:0:15716:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af7389e00/0x7cd2bfd5e1b958c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958d0 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788744432.102612:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788744432.102617:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744432.102618:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744432.102620:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744432.102621:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744432.102622:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744432.102623:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744432.102625:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744432.102626:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744432.102630:0:15716:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788744432.102632:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788744432.102633:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788744432.102634:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788744432.102635:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788744432.102636:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788744432.102638:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788744432.102638:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788744432.102639:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788744432.102640:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788744432.102665:0:15716:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788744432.102686:0:15716:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788744432.102769:0:15716:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.103301:0:15716:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad0d233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744432.103643:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491904 00000100:00100000:2.0:1788744432.103653:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491904 00000100:00100000:2.0:1788744432.103745:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788744432.103765:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:15716:x1875634068491904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788744432.103805:0:14305:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788744432.103821:0:14305:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1788744432.104602:0:14727:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788744432.104608:0:14727:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788744432.104611:0:14727:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788744432.104617:0:14727:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 503 00000100:00080000:2.0:1788744432.104622:0:14727:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788744432.104630:0:14727:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:2.0:1788744432.104662:0:14727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73ced80 x1875634068492160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788744432.104738:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744432.105100:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068491776:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788744432.109095:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068492416:0@lo:400:kworker.0 00000100:00100000:0.0:1788744432.109271:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744432.109347:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068492160:0@lo:8:kworker.0 00000100:00100000:0.0:1788744432.109378:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744432.109435:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068491776 00000100:00100000:0.0:1788744432.109443:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068491776 00000100:00100000:0.0:1788744432.109485:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744432.109495:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1875634068491776:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788744432.109570:0:14312:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1788744432.109616:0:14312:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7cd2bfd5e1b958e5 00000004:00100000:0.0:1788744432.109631:0:14312:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788744432.109664:0:14312:0:(import.c:65:import_set_state_nolock()) ffff9409c3650000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744432.109724:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875634068491776:12345-0@lo:38:llog_process_th.0 Request processed in 228us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744432.109732:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744432.109771:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492160 00000100:00100000:0.0:1788744432.109775:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492160 00000100:00100000:2.0:1788744432.110095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.110123:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788744432.110131:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068492288:0@lo:400:kworker.0 00000100:00100000:2.0:1788744432.110159:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.110233:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492032 00000100:00100000:2.0:1788744432.110237:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492032 00000100:00100000:2.0:1788744432.110270:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744432.110277:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068492032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744432.110320:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068492032:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.110326:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744432.110650:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068492032:0@lo:400:kworker.0 00000100:00100000:0.0:1788744432.110821:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492288 00000100:00100000:0.0:1788744432.110826:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492288 00000100:00100000:0.0:1788744432.110855:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744432.110862:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068492288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744432.110900:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875634068492288:12345-0@lo:400:kworker.0 Request processed in 39us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744432.111085:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788744432.111118:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af73cf800 x1875634068491776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788744442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744432.111128:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744432.111136:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788744432.111143:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788744432.111147:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788744432.111150:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad2f12000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788744432.111156:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875634068491776:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788744432.111182:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744432.111187:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068492160:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788744432.111302:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068492160:12345-0@lo:8:kworker.0 Request processed in 113us (1922us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788744432.111308:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744432.111336:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788744432.111340:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788744432.111353:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788744432.111356:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068492160:0@lo:8:kworker.0 00010000:00080000:0.0:1788744432.111389:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af73cdc00 x1875634068492288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744432.111398:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875634068492288:0@lo:400:kworker.0 00000100:00100000:3.0:1788744432.119327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744432.119521:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492416 00000100:00100000:1.0:1788744432.119532:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492416 00000100:00100000:1.0:1788744432.119617:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744432.119627:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068492416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744432.119686:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875634068492416:12345-0@lo:400:kworker.0 Request processed in 62us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744432.119692:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788744432.120303:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff940af73cfb80 x1875634068492416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744432.120319:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875634068492416:0@lo:400:kworker.0 20000000:01000000:3.0:1788744432.141448:0:14305:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788744432.141468:0:14305:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788744432.141727:0:14327:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788744432.141732:0:14327:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788744432.141766:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.141785:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.141793:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.141831:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 19 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.141863:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 19 pid: 14304 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744432.141878:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068492544:0@lo:104: 00000100:00100000:2.0:1788744432.142154:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744432.142202:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff940af70919c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744432.142282:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492544 00000100:00100000:3.0:1788744432.142291:0:14295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492544 00000100:00100000:3.0:1788744432.142341:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744432.142352:0:14295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068492544:12345-0@lo:104: 00010000:00010000:3.0:1788744432.142373:0:14295:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.142419:0:14295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788744432.142425:0:14295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:14327:x1875634068492544:12345-0@lo:104: Request processed in 75us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744432.142432:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788744432.143124:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744432.143132:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143140:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac13fc000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:2.0:1788744432.143144:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143154:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788744432.143161:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788744432.143167:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788744432.143211:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143331:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788744432.143385:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068492672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744432.143431:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788744432.143489:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143497:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940ac13fc000/0x7cd2bfd5e1b957bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b957c6 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143525:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744432.143527:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744432.143528:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744432.143576:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14327:1875634068492544:0@lo:104: 00010000:00010000:2.0:1788744432.143595:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744432.143667:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492672 00000100:00100000:3.0:1788744432.143673:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492672 00010000:00010000:3.0:1788744432.143696:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 20 pid: 14304 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744432.143731:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788744432.143740:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+20:3311:x1875634068492672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788744432.143763:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744432.143768:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 20 pid: 14304 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143779:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 20 pid: 14304 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143793:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940afaa77600/0x7cd2bfd5e1b957c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b957bf expref: 20 pid: 14304 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143805:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143814:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788744432.143837:0:14296:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011521764s 00010000:00010000:3.0:1788744432.143842:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143848:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143855:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143862:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143867:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744432.143871:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143878:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143890:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744432.143898:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788744432.143964:0:14327:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143972:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744432.143979:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7389600/0x7cd2bfd5e1b958ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744432.145242:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3311:x1875634068492672:12345-0@lo:103:ldlm_bl.0 Request processed in 1497us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744432.145253:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744432.149924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068492672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788744432.150810:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:15716:x1875634068491904:12345-0@lo:253:mount.lustre.0 Request processed in 47054us (48038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744432.150824:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788744432.150896:0:15716:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:15716:1875634068491904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788744432.150973:0:15716:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788744432.150977:0:15716:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788744432.150979:0:15716:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788744432.150980:0:15716:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788744432.150982:0:15716:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788744432.150983:0:15716:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788744432.150984:0:15716:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788744432.150986:0:15716:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788744432.150988:0:15716:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788744432.150989:0:15716:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788744432.151004:0:15716:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788744432.157129:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744432.157395:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788744432.157665:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744432.157840:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788744432.158147:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788744432.158434:0:15716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788744432.160014:0:15716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788744432.211452:0:15716:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788744432.211464:0:15716:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788744432.211504:0:15716:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788744432.211657:0:15716:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788744432.211677:0:15716:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788744432.211715:0:15716:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788744432.675814:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788744432.989588:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788744433.189009:0:14308:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788744433.189024:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff940ac2d3a000 from 8 10000000:01000000:1.0:1788744433.189028:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788744433.189077:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189089:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189100:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744433.189124:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068492800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744433.189193:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744433.189251:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7f98180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744433.189275:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492800 00000100:00100000:1.0:1788744433.189284:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492800 00000100:00100000:1.0:1788744433.189329:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744433.189337:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068492800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744433.189351:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744433.189363:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2a00/0x7cd2bfd5e1b958fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b958f3 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189386:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2a00/0x7cd2bfd5e1b958fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958f3 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189397:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2a00/0x7cd2bfd5e1b958fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958f3 expref: 19 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189405:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2a00, rc 0) 00000100:00100000:1.0:1788744433.189440:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068492800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.189453:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788744433.189503:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068492800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744433.189518:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958fa expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.189526:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b958fa expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744433.189602:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068492928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788744433.189634:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744433.189649:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7f98180 going to sleep for 11 seconds 00000100:00100000:1.0:1788744433.189662:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068492928 00000100:00100000:1.0:1788744433.189666:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068492928 00000100:00100000:1.0:1788744433.189686:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744433.189692:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068492928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788744433.189708:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788744433.189752:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788744433.189757:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788744433.189831:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068492928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744433.189838:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788744433.189866:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068492928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788744433.190002:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788744433.190010:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958fa expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744433.190027:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d3a00/0x7cd2bfd5e1b958f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b958fa expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744433.694768:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744434.714991:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744435.743673:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744436.251142:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068493056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744436.251229:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744436.251316:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493056 00000100:00100000:3.0:1788744436.251324:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493056 00000100:00100000:3.0:1788744436.251388:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744436.251398:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068493056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788744436.251449:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744436.251499:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068493056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744436.251506:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788744436.251582:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068493056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788744436.255954:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788744436.762819:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788744437.284073:0:14727:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788744437.284080:0:14727:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788744437.284085:0:14727:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788744437.284102:0:14727:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff940ad0cf2800 using connection 192.168.204.156@tcp/0@lo 00000100:00100000:3.0:1788744437.284125:0:14727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff940af73ab100 x1875634068493440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788744437.284177:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068493696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744437.284238:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744437.284299:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788744437.284306:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068493184:0@lo:400:kworker.0 00000100:00100000:3.0:1788744437.284336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744437.284358:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068493824:0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.284517:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068493568:0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.284567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744437.284603:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744437.284610:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068493312:0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.284635:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744437.284669:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068493440:0@lo:8:kworker.0 00000100:00100000:0.0:1788744437.284692:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744437.284722:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493696 00000100:00100000:0.0:1788744437.284730:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493696 00000100:00100000:0.0:1788744437.284779:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493568 00000100:00100000:0.0:1788744437.284783:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493568 00000100:00100000:0.0:1788744437.284885:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744437.284896:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068493696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.284947:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068493696:12345-0@lo:400:kworker.0 Request processed in 52us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744437.284954:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744437.284974:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744437.284979:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068493568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.285011:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068493568:12345-0@lo:400:kworker.0 Request processed in 32us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744437.285017:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744437.285037:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493312 00000100:00100000:0.0:1788744437.285041:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493312 00000100:00100000:0.0:1788744437.285064:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493440 00000100:00100000:0.0:1788744437.285067:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493440 00000100:00100000:0.0:1788744437.285078:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744437.285083:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068493312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744437.285113:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068493312:12345-0@lo:400:kworker.0 Request processed in 30us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744437.285119:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744437.285140:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744437.285145:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875634068493440:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788744437.285172:0:14998:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1788744437.285205:0:14998:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7cd2bfd5e1b95901 00002000:00100000:0.0:1788744437.285221:0:14998:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9409c3657800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788744437.285226:0:14998:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788744437.285229:0:14998:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788744437.285990:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493184 00000100:00100000:1.0:1788744437.285999:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493184 00000100:00100000:1.0:1788744437.286038:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788744437.286048:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068493184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744437.286110:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068493184:12345-0@lo:400:kworker.0 Request processed in 64us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744437.286115:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788744437.286950:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788744437.287000:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73a9880 x1875634068493696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744437.287035:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068493696:0@lo:400:kworker.0 00000100:00100000:3.0:1788744437.287062:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068493184:0@lo:400:kworker.0 00000100:00100000:1.0:1788744437.287148:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493824 00000100:00100000:1.0:1788744437.287155:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493824 00000100:00100000:1.0:1788744437.287205:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744437.287214:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068493824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744437.287263:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068493824:12345-0@lo:400:kworker.0 Request processed in 50us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744437.287269:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788744437.287929:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788744437.288020:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73a8000 x1875634068493824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788744437.288032:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068493824:0@lo:400:kworker.0 00002000:00080000:0.0:1788744437.288667:0:14998:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788744437.288699:0:14998:0:(import.c:65:import_set_state_nolock()) ffff9409c3654800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744437.288792:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875634068493440:12345-0@lo:8:kworker.0 Request processed in 3644us (4097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744437.288884:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744437.288940:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068493312:0@lo:400:kworker.0 00010000:00080000:0.0:1788744437.288955:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73a8a80 x1875634068493568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788744453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744437.288966:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068493568:0@lo:400:kworker.0 00010000:00080000:1.0:1788744437.289874:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940af73ab100 x1875634068493440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788744462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788744437.289891:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788744437.289900:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788744437.289906:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788744437.289909:0:3309:0:(import.c:65:import_set_state_nolock()) ffff940ad0cf2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788744437.289934:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788744437.289940:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875634068493440:0@lo:8:kworker.0 00000004:00080000:3.0:1788744437.290098:0:14335:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788744437.291094:0:14335:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 509423542460ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788744437.291515:0:14336:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788744437.291541:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14336:1875634068494080:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788744437.291619:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744437.291665:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad3b0de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744437.291683:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788744437.291695:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068493952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744437.291721:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744437.291766:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494080 00000100:00100000:0.0:1788744437.291774:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494080 00000100:00100000:0.0:1788744437.291914:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788744437.291924:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14336:x1875634068494080:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788744437.295066:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068493952 00000100:00100000:0.0:1788744437.295084:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068493952 00000100:00100000:0.0:1788744437.295139:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788744437.295148:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068493952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744437.295186:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744437.295276:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875634068493952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (3553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744437.295284:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788744437.295307:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788744437.295349:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff940ad31e5f80 x1875634068493952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788744453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788744437.296486:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068493952:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788744437.316428:0:14999:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788744437.316441:0:14999:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788744437.316448:0:14999:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788744437.346087:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.346100:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346120:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.346124:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.346130:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346148:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346159:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346167:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346188:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.346206:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.346212:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346232:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.346237:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346247:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346266:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346273:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016915d45/0x7cd2bfd5e1b95908 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.346294:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.346295:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.346297:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.346994:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.347001:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347011:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.347013:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.347017:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347027:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347043:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347050:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347065:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788744437.347466:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.347472:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347481:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.347484:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.347488:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347498:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347506:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347513:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347542:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788744437.347578:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744437.347584:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347592:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.347595:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347605:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347619:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347626:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca0fc689/0x7cd2bfd5e1b9590f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347641:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.347644:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347650:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.347667:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347685:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347695:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347702:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad73fc21/0x7cd2bfd5e1b95916 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.347715:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.347717:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.347719:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.348105:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.348111:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348120:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.348124:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.348128:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348138:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348146:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348159:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348174:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.348183:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.348187:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348194:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.348198:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348206:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348217:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348224:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042808c65/0x7cd2bfd5e1b9591d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.348237:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.348239:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.348240:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.350723:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.352545:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.352603:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.352625:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.352630:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.352638:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.352836:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.352851:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.352860:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.352881:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.354174:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.354186:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.354199:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.354204:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.354215:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.354257:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.354265:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022919104/0x7cd2bfd5e1b95924 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.354287:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.354289:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.354291:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.355529:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.355544:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.355594:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.355599:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.355607:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.355621:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.355640:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.355648:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.355678:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.357087:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.357097:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357110:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7389800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.357114:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357123:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357145:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357152:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d5295e/0x7cd2bfd5e1b9592b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357186:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.357188:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.357190:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.357191:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.357197:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.357207:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.357211:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.357215:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.357226:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.357234:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.357242:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.357268:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.357347:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.357352:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357360:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.357363:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357729:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357893:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357903:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206a4c4d/0x7cd2bfd5e1b95932 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.357926:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.357928:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.357930:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.358041:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.358048:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358057:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.358061:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.358064:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358074:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358083:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358099:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358137:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744437.358464:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744437.358472:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.358481:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24de800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744437.358484:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.358493:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.358510:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.358517:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc25d3d5/0x7cd2bfd5e1b95939 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.358536:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.358538:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.358539:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.358636:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.358642:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358662:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.358672:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.358676:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358686:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358695:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358702:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.358713:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.358919:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.358924:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.358941:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dee00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.358944:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.358952:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.358962:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.359048:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000015beb66/0x7cd2bfd5e1b95940 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.359063:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.359065:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.359066:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.359096:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.359101:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.359109:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.359112:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.359116:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.359125:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.359132:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.359146:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.359164:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744437.360391:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744437.360402:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.360413:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dec00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744437.360417:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.360439:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.360456:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.360464:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b94be83f/0x7cd2bfd5e1b95947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.360492:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.360494:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.360496:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.366606:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.366622:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.366643:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.366649:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.366666:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.366683:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.366694:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367057:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367078:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.367235:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.367243:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.367251:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.367256:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.367264:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.367290:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.367296:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007014caf/0x7cd2bfd5e1b9594e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.367313:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.367315:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.367317:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.367778:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.367785:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367804:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.367808:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.367813:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367825:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367833:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367841:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.367855:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788744437.367912:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788744437.367919:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.367927:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dea00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744437.367931:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.367939:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.367953:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.368580:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95955 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788744437.368685:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.368691:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.368700:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.368704:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.368707:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.368718:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.368723:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.368725:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.368726:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.368737:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.368744:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.368757:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.369071:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.369078:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.369087:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.369091:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.369100:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.369114:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.369121:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a16b4c8/0x7cd2bfd5e1b9595c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.369146:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.369148:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.369150:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.370344:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.370357:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370584:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.370590:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.370596:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370611:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370621:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370629:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370678:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.370691:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.370696:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370704:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.370709:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370717:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370733:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370741:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a33395e/0x7cd2bfd5e1b95963 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.370760:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.370762:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.370764:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.371409:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.371417:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.371428:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.371437:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.371442:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.371452:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.371460:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.371467:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.371485:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.372528:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.372539:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.372569:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dfc00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.372573:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.372583:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.372603:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.372610:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd0940a0/0x7cd2bfd5e1b9596a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.372629:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.372631:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.372632:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788744437.373993:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788744437.374003:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.374017:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=509s v=(0 0) 00010000:00010000:2.0:1788744437.374022:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744437.374028:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.374042:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.374051:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.374067:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.374084:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788744437.374721:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788744437.376285:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744437.376300:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.376312:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744437.376317:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.376327:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.376356:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.376364:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000451f52f0/0x7cd2bfd5e1b95971 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.376408:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.376410:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.376413:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.381073:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.381089:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.381107:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.381112:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.381118:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.381133:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.381145:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.381153:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.381190:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.383647:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.383671:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.383685:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031a00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.383690:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.383702:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.383726:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.383734:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000eff63cc/0x7cd2bfd5e1b95978 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.383756:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.383758:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.383759:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.385124:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.385137:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.385168:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.385174:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.385181:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.385197:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.385208:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.385217:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.385245:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.385290:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.385301:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.385310:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.385314:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.385323:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.385339:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.385347:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b208bc3/0x7cd2bfd5e1b9597f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.385364:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.385366:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.385367:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.387078:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.387094:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.387109:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.387113:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.387119:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.387133:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.387158:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.387167:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.387185:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.387274:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.387282:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.387291:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031e00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.387295:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.387316:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.387340:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.387348:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f3f3a22/0x7cd2bfd5e1b95986 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.387368:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.387370:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.387372:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.390537:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.393272:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.393300:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.393306:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.393313:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.393336:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.393347:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.393355:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.393417:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.394213:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.394224:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.394235:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.394241:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.394250:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.394271:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.394291:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000252abd5f/0x7cd2bfd5e1b9598d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.394314:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.394316:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.394317:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.394462:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.394468:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.394479:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.394484:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.394489:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.394501:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.394509:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.394516:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.394540:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744437.395028:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.395035:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.395044:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.395054:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.395058:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.395068:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.395076:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.395084:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396319:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.396331:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396346:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.396351:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396361:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396382:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396389:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdac526f/0x7cd2bfd5e1b95994 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.396414:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.396416:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.396418:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.396715:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744437.397380:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.397387:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.397401:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.397405:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.397410:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.397424:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.397433:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.397447:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398594:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744437.398605:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398617:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.398622:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398630:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398649:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398667:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004edaf72a/0x7cd2bfd5e1b9599b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398688:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.398691:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398697:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0031600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.398700:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398707:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398731:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.398739:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.398740:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.398742:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.398836:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788744437.398844:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a55d61/0x7cd2bfd5e1b959a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744437.401282:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.401296:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.401314:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.401319:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.401326:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.401341:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.401352:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.401361:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.402922:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.402938:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.402952:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac0030600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.402958:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.402969:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.402993:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744437.403462:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.403466:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788744437.403469:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.405283:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788744437.405298:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56b84e6/0x7cd2bfd5e1b959a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.406278:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.406403:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.406414:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.406431:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.406436:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.406443:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.406458:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.406468:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.406476:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.406505:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788744437.406846:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744437.406858:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.406879:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744437.406884:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.406895:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.406917:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.406926:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b342ec7/0x7cd2bfd5e1b959b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744437.406945:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.406947:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744437.406949:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.407054:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.407060:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.407075:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.407079:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.407083:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.411670:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.411689:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.411698:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.411721:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788744437.412238:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.412246:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.412256:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.412267:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.412278:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.412296:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.412304:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007321613b/0x7cd2bfd5e1b959b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.412327:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.412328:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.412330:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788744437.414130:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.414142:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.414158:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.414163:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.414170:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.414185:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.414207:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.414214:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.414287:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788744437.415272:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788744437.415280:0:14999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.415293:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=509s v=(0 0) 00010000:00010000:3.0:1788744437.415296:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744437.415300:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.415313:0:14999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.415321:0:14999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744437.415329:0:14999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416820:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788744437.416833:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416845:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb800 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.416850:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416861:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416882:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416903:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb69f26/0x7cd2bfd5e1b959be lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416931:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788744437.416935:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416942:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cbc00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744437.416945:0:14300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416953:0:14300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416964:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744437.416971:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.416973:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744437.416975:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744437.423496:0:14999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788744437.423515:0:14999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080f69c81/0x7cd2bfd5e1b959c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788744437.423963:0:14999:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788744437.424066:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14336:x1875634068494080:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132139us (132442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744437.424080:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788744437.424140:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14336:1875634068494080:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788744437.424154:0:14336:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1788744437.424202:0:14336:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14336:1875634068494208:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788744437.424237:0:14336:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744437.424277:0:14336:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad81886c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744437.424295:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494208 00000100:00100000:3.0:1788744437.424301:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494208 00000100:00100000:3.0:1788744437.424343:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788744437.424352:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14336:x1875634068494208:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788744437.424523:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788744437.426565:0:14996:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788744437.437281:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14336:x1875634068494208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12923us (13036us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788744437.437294:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744437.437466:0:14336:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73a8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14336:1875634068494208:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788744437.437486:0:14336:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788744437.787188:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744438.816059:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788744438.868186:0:16074:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg456-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788744439.840792:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744440.858718:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744441.373284:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744441.373309:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068494336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744441.373383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744441.373452:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494336 00000100:00100000:0.0:1788744441.373461:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494336 00000100:00100000:0.0:1788744441.373518:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744441.373543:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068494336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744441.373619:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744441.373666:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068494336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.373673:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788744441.373697:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744441.373733:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068494336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788744441.485768:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.485894:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525504 00000100:00100000:0.0:1788744441.485904:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525504 00000100:00100000:0.0:1788744441.485944:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00100000:0.0:1788744441.485953:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2350:x1875634047525504:12345-192.168.204.56@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788744441.485994:0:14306:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from d9d4cdde-e6b8-4c5c-b056-f647979e858e@192.168.204.56@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:0.0:1788744441.486023:0:14306:0:(genops.c:1384:class_connect()) connect: client d9d4cdde-e6b8-4c5c-b056-f647979e858e, cookie 0x7cd2bfd5e1b959cc 00000100:00080000:0.0:1788744441.486148:0:14306:0:(import.c:65:import_set_state_nolock()) ffff9409c3655800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744441.486218:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+5:2350:x1875634047525504:12345-192.168.204.56@tcp:250:mount.lustre.0 Request processed in 266us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.486226:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 75 00000100:00100000:0.0:1788744441.503500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.505309:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525632 00000100:00100000:1.0:1788744441.505322:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525632 00000100:00100000:1.0:1788744441.505392:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 76 00000100:00100000:1.0:1788744441.505403:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad310c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+5:13728:x1875634047525632:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744441.505418:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744441.505434:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b959d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761533 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.505464:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b959d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761533 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.505476:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d3200/0x7cd2bfd5e1b959d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761533 expref: 6 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.505485:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3200, rc 0) 00000100:00100000:1.0:1788744441.506114:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad310c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+6:13728:x1875634047525632:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 707us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.506122:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 76 00000100:00100000:3.0:1788744441.512102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.512432:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525760 00000100:00100000:0.0:1788744441.512443:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525760 00000100:00100000:0.0:1788744441.512595:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:0.0:1788744441.512622:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+6:13728:x1875634047525760:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744441.513210:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+6:13728:x1875634047525760:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 590us (1123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788744441.513219:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 77 00000100:00100000:3.0:1788744441.516865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.517004:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047525888 00000100:00100000:1.0:1788744441.517015:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047525888 00000100:00100000:1.0:1788744441.517076:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:1.0:1788744441.517087:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+6:13728:x1875634047525888:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744441.517107:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744441.517129:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2600/0x7cd2bfd5e1b959da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576153a expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.517162:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2600/0x7cd2bfd5e1b959da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576153a expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.517174:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2600/0x7cd2bfd5e1b959da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576153a expref: 7 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.517185:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2600, rc 0) 00000100:00100000:1.0:1788744441.517257:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+7:13728:x1875634047525888:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 171us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.517264:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 78 00000100:00100000:1.0:1788744441.521291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.521842:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526016 00000100:00100000:0.0:1788744441.521859:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526016 00000100:00100000:0.0:1788744441.521930:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:0.0:1788744441.521941:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+7:13728:x1875634047526016:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744441.522279:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13728:x1875634047526016:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 339us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.522288:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 79 00000100:00100000:3.0:1788744441.524678:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.524917:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526144 00000100:00100000:0.0:1788744441.524927:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526144 00000100:00100000:0.0:1788744441.524995:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 80 00000100:00100000:0.0:1788744441.525007:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13728:x1875634047526144:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744441.525327:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13728:x1875634047526144:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 321us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.525335:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 80 00000100:00100000:3.0:1788744441.531169:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.531462:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526272 00000100:00100000:0.0:1788744441.531473:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526272 00000100:00100000:0.0:1788744441.531538:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:0.0:1788744441.531596:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13746:x1875634047526272:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744441.531965:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13746:x1875634047526272:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 416us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.531974:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 81 00000100:00100000:1.0:1788744441.559245:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.559865:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526400 00000100:00100000:0.0:1788744441.559876:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526400 00000100:00100000:0.0:1788744441.559938:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:0.0:1788744441.559949:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13746:x1875634047526400:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744441.560334:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13746:x1875634047526400:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 385us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.560344:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 82 00000100:00100000:3.0:1788744441.582901:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744441.583063:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526528 00000100:00100000:2.0:1788744441.583077:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526528 00000100:00100000:2.0:1788744441.583179:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 83 00000100:00100000:2.0:1788744441.583190:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+8:13728:x1875634047526528:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744441.583209:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744441.583233:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24de600/0x7cd2bfd5e1b959e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761564 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744441.583263:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24de600/0x7cd2bfd5e1b959e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761564 expref: 9 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744441.583273:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24de600/0x7cd2bfd5e1b959e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761564 expref: 9 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744441.583281:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24de600, rc 0) 00000100:00100000:2.0:1788744441.583350:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace18d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+9:13728:x1875634047526528:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 161us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744441.583357:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 83 00000100:00100000:3.0:1788744441.586288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.586393:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526656 00000100:00100000:1.0:1788744441.586407:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526656 00000100:00100000:1.0:1788744441.586510:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 84 00000100:00100000:1.0:1788744441.586526:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+9:13728:x1875634047526656:12345-192.168.204.56@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788744441.586607:0:14305:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788744441.586633:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788744441.586638:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788744441.586641:0:14305:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788744441.586651:0:14305:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788744441.591222:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+9:13728:x1875634047526656:12345-192.168.204.56@tcp:256:mount.lustre.0 Request processed in 4689us (4932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.591236:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 84 00000100:00100000:2.0:1788744441.597788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.597878:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526784 00000100:00100000:1.0:1788744441.597889:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526784 00000100:00100000:1.0:1788744441.597952:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:1.0:1788744441.597964:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+9:13728:x1875634047526784:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788744441.597983:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744441.598001:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576156b expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.598031:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 10 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.598043:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 10 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744441.598051:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2200, rc 0) 00000100:00100000:1.0:1788744441.598119:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13728:x1875634047526784:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 157us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.598128:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 85 00000100:00100000:3.0:1788744441.603084:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.603308:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047526912 00000100:00100000:1.0:1788744441.603320:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047526912 00000100:00100000:1.0:1788744441.603412:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:1.0:1788744441.603435:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13728:x1875634047526912:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788744441.604020:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13728:x1875634047526912:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 597us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.604040:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 86 00000100:00100000:3.0:1788744441.608299:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.608391:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527040 00000100:00100000:0.0:1788744441.608405:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527040 00000100:00100000:0.0:1788744441.608480:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00100000:0.0:1788744441.608492:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13728:x1875634047527040:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744441.609687:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13728:x1875634047527040:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 1190us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.609699:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 87 00000100:00100000:1.0:1788744441.614285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744441.615121:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527168 00000100:00100000:0.0:1788744441.615133:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527168 00000100:00100000:0.0:1788744441.615234:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:0.0:1788744441.615245:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13750:x1875634047527168:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744441.615606:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13750:x1875634047527168:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 361us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.615614:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 88 00000100:00100000:3.0:1788744441.628839:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744441.629025:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527296 00000100:00100000:2.0:1788744441.629036:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527296 00000100:00100000:2.0:1788744441.629101:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 89 00000100:00100000:2.0:1788744441.629115:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13750:x1875634047527296:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744441.629402:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13750:x1875634047527296:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 289us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744441.629411:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 89 00000100:00100000:2.0:1788744441.658813:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.659124:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527424 00000100:00100000:1.0:1788744441.659139:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527424 00000100:00100000:1.0:1788744441.659200:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:1.0:1788744441.659209:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1875634047527424:12345-192.168.204.56@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788744441.659240:0:14312:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 485aaa4b-4c98-4e00-ad7e-2419ecd72724@192.168.204.56@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1788744441.659294:0:14312:0:(genops.c:1384:class_connect()) connect: client 485aaa4b-4c98-4e00-ad7e-2419ecd72724, cookie 0x7cd2bfd5e1b959ef 00000004:00100000:1.0:1788744441.659326:0:14312:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788744441.659332:0:14312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788744441.710699:0:14312:0:(import.c:65:import_set_state_nolock()) ffff940ac6078000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744441.711141:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2350:x1875634047527424:12345-192.168.204.56@tcp:38:mount.lustre.0 Request processed in 51929us (52334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744441.711152:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:3.0:1788744441.714462:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744441.714593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744441.715060:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527680 00000100:00100000:1.0:1788744441.715073:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527680 00000100:00100000:1.0:1788744441.715192:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527552 00000100:00100000:1.0:1788744441.715196:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527552 00000100:00100000:0.0:1788744441.715231:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:0.0:1788744441.715244:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:13728:x1875634047527680:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744441.715291:0:15478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744441.715379:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:13728:x1875634047527680:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 137us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.715386:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:0.0:1788744441.715405:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:0.0:1788744441.715429:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:0:x1875634047527552:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744441.715441:0:15478:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744441.715466:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:0:x1875634047527552:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 38us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744441.715472:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00080000:2.0:1788744441.715542:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744441.718385:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744441.718467:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527808 00000100:00100000:3.0:1788744441.718477:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527808 00000100:00100000:3.0:1788744441.718533:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:3.0:1788744441.718545:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13728:x1875634047527808:12345-192.168.204.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788744441.718653:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13728:x1875634047527808:12345-192.168.204.56@tcp:40:mount.lustre.0 Request processed in 110us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744441.718670:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:2.0:1788744441.721671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744441.721706:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744441.721756:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744441.721786:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047527936 00000100:00100000:2.0:1788744441.721798:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047527936 00000100:00100000:2.0:1788744441.721832:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528064 00000100:00100000:2.0:1788744441.721835:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528064 00000100:00100000:2.0:1788744441.721849:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744441.721858:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875634047527936:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788744441.721891:0:14999:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 485aaa4b-4c98-4e00-ad7e-2419ecd72724@192.168.204.56@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1788744441.721921:0:14999:0:(genops.c:1384:class_connect()) connect: client 485aaa4b-4c98-4e00-ad7e-2419ecd72724, cookie 0x7cd2bfd5e1b959f6 00002000:00100000:2.0:1788744441.721932:0:14999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 485aaa4b-4c98-4e00-ad7e-2419ecd72724/ffff940ace675800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744441.721944:0:14999:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744441.722285:0:14999:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788744441.722318:0:14999:0:(import.c:65:import_set_state_nolock()) ffff940ace673800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744441.722387:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2350:x1875634047527936:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 528us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744441.722395:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744441.722415:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:2.0:1788744441.722420:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875634047528064:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788744441.722435:0:14999:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 485aaa4b-4c98-4e00-ad7e-2419ecd72724@192.168.204.56@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:2.0:1788744441.722450:0:14999:0:(genops.c:1384:class_connect()) connect: client 485aaa4b-4c98-4e00-ad7e-2419ecd72724, cookie 0x7cd2bfd5e1b959fd 00002000:00100000:2.0:1788744441.722456:0:14999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 485aaa4b-4c98-4e00-ad7e-2419ecd72724/ffff940ace677800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788744441.722488:0:14999:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788744441.722657:0:14999:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788744441.722675:0:14999:0:(import.c:65:import_set_state_nolock()) ffff940ace674800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788744441.722701:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2350:x1875634047528064:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 279us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744441.722709:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:3.0:1788744441.723017:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528192 00000100:00100000:3.0:1788744441.723024:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528192 00000100:00100000:3.0:1788744441.723068:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:3.0:1788744441.723077:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13728:x1875634047528192:12345-192.168.204.56@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788744441.723707:0:14314:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 570us 00000004:00200000:2.0:1788744441.743167:0:14314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744441.743315:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13728:x1875634047528192:12345-192.168.204.56@tcp:33:mount.lustre.0 Request processed in 20233us (21659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744441.743329:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00010000:00010000:2.0:1788744441.885083:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744441.959094:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744441.959206:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528320 00000100:00100000:3.0:1788744441.959220:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528320 00000100:00100000:3.0:1788744441.959294:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744441.959307:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13771:x1875634047528320:12345-192.168.204.56@tcp:101:mkdir.0 00010000:00010000:3.0:1788744441.959329:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744441.959369:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95a04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761595 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959442:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959457:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959471:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744441.959513:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788744441.959517:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788744441.959600:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959628:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95a04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761595 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959648:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761595 expref: 7 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744441.959658:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:3.0:1788744441.959675:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788744441.959679:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cbc00, rc 0) 00000100:00100000:3.0:1788744441.959875:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:13771:x1875634047528320:12345-192.168.204.56@tcp:101:mkdir.0 Request processed in 569us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744441.959882:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000040:00080000:3.0:1788744442.204221:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788744442.395123:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068494464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744442.395205:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744442.395410:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494464 00000100:00100000:0.0:1788744442.395420:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494464 00000100:00100000:0.0:1788744442.395501:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744442.395512:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875634068494464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744442.395534:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744442.395617:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875634068494464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744442.395624:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744442.395808:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068494464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788744442.396006:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068494720:0@lo:400:kworker.0 00000100:00100000:2.0:1788744442.396243:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744442.396275:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788744442.396282:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068494848:0@lo:400:kworker.0 00000100:00100000:2.0:1788744442.396315:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744442.396354:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494720 00000100:00100000:2.0:1788744442.396360:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494720 00000100:00100000:2.0:1788744442.396395:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744442.396404:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068494720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744442.396472:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068494720:12345-0@lo:400:kworker.0 Request processed in 70us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744442.396480:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788744442.396518:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068494720:0@lo:400:kworker.0 00000100:00100000:2.0:1788744442.396543:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494848 00000100:00100000:2.0:1788744442.396609:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494848 00000100:00100000:2.0:1788744442.396642:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788744442.396648:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068494848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.396859:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068494976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.396890:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744442.396924:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788744442.396931:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068494592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.396960:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744442.396991:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068495104:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744442.397041:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494592 00000100:00100000:0.0:1788744442.397163:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494592 00000100:00100000:0.0:1788744442.397195:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788744442.397201:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068494592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397250:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068494592:12345-0@lo:400:kworker.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744442.397257:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788744442.397287:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068494976 00000100:00100000:0.0:1788744442.397292:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068494976 00000100:00100000:0.0:1788744442.397312:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495104 00000100:00100000:0.0:1788744442.397314:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495104 00000100:00100000:0.0:1788744442.397331:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744442.397338:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068494976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397369:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875634068494976:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744442.397375:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788744442.397389:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744442.397396:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068495104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397421:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068495104:12345-0@lo:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744442.397427:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788744442.397454:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068494592:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397467:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068495104:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397478:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875634068494976:0@lo:400:kworker.0 00000100:00100000:0.0:1788744442.397531:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068494848:0@lo:400:kworker.0 00000100:00080000:3.0:1788744442.398172:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788744442.398180:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744442.398502:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068494848:12345-0@lo:400:kworker.0 Request processed in 36us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744442.398516:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00100000:0.0:1788744442.546430:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788744442.547353:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 485aaa4b-4c98-4e00-ad7e-2419ecd72724 00000001:00080000:0.0:1788744442.547393:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1788744442.917392:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744443.930903:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744444.144618:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.144690:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528448 00000100:00100000:0.0:1788744444.144702:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528448 00000100:00100000:0.0:1788744444.144801:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:0.0:1788744444.144815:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:13824:x1875634047528448:12345-192.168.204.56@tcp:41:lfs.0 00000004:00000024:0.0:1788744444.144868:0:14312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744444.145241:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:13824:x1875634047528448:12345-192.168.204.56@tcp:41:lfs.0 Request processed in 428us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.145250:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00080000:3.0:1788744444.145322:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744444.161429:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.161641:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528576 00000100:00100000:0.0:1788744444.161663:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528576 00000100:00100000:0.0:1788744444.161744:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:0.0:1788744444.161757:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13824:x1875634047528576:12345-192.168.204.56@tcp:13:lfs.0 00002000:00000024:0.0:1788744444.161807:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744444.161900:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:13824:x1875634047528576:12345-192.168.204.56@tcp:13:lfs.0 Request processed in 146us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.161908:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00080000:3.0:1788744444.162409:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744444.167353:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.167434:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528704 00000100:00100000:0.0:1788744444.167446:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528704 00000100:00080000:3.0:1788744444.167618:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788744444.167731:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:0.0:1788744444.167744:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:13824:x1875634047528704:12345-192.168.204.56@tcp:13:lfs.0 00002000:00000024:0.0:1788744444.167791:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744444.167897:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:13824:x1875634047528704:12345-192.168.204.56@tcp:13:lfs.0 Request processed in 155us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.167905:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:3.0:1788744444.429167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.429280:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528832 00000100:00100000:0.0:1788744444.429293:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528832 00000100:00100000:0.0:1788744444.429381:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 91 00000100:00100000:0.0:1788744444.429392:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+10:13856:x1875634047528832:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788744444.429410:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744444.429428:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940afaa77a00/0x7cd2bfd5e1b95a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb576159c expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744444.429458:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940afaa77a00/0x7cd2bfd5e1b95a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576159c expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744444.429469:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940afaa77a00/0x7cd2bfd5e1b95a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576159c expref: 11 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744444.429479:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77a00, rc 0) 00000100:00100000:0.0:1788744444.429582:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047528832:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 192us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.429590:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 91 00000100:00100000:3.0:1788744444.431790:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.432339:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047528960 00000100:00100000:0.0:1788744444.432351:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047528960 00000100:00100000:0.0:1788744444.432419:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:0.0:1788744444.432430:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047528960:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788744444.432797:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047528960:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 368us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.432806:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 92 00000100:00100000:3.0:1788744444.440808:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.440927:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529088 00000100:00100000:2.0:1788744444.440938:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529088 00000100:00100000:2.0:1788744444.440996:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:2.0:1788744444.441008:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047529088:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788744444.441256:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047529088:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 249us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.441264:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 93 00000100:00100000:3.0:1788744444.483088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.484756:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529216 00000100:00100000:1.0:1788744444.484773:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529216 00000100:00100000:1.0:1788744444.484856:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 94 00000100:00100000:1.0:1788744444.484868:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13862:x1875634047529216:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744444.485164:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13862:x1875634047529216:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 297us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.485173:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 94 00000100:00100000:3.0:1788744444.513952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.514076:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529344 00000100:00100000:0.0:1788744444.514087:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529344 00000100:00100000:0.0:1788744444.514171:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 95 00000100:00100000:0.0:1788744444.514183:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13862:x1875634047529344:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788744444.514504:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13862:x1875634047529344:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 322us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.514523:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 95 00000100:00100000:3.0:1788744444.522098:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.522600:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529472 00000100:00100000:2.0:1788744444.522621:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529472 00000100:00100000:2.0:1788744444.522688:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 96 00000100:00100000:2.0:1788744444.522698:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13856:x1875634047529472:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744444.522718:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744444.522736:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24de400/0x7cd2bfd5e1b95a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57615c6 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.522771:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24de400/0x7cd2bfd5e1b95a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615c6 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.522806:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24de400/0x7cd2bfd5e1b95a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615c6 expref: 12 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.522817:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24de400, rc 0) 00000100:00100000:2.0:1788744444.522875:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13856:x1875634047529472:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 178us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.522881:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 96 00000100:00100000:3.0:1788744444.526656:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.527007:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529600 00000100:00100000:1.0:1788744444.527036:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529600 00000100:00100000:1.0:1788744444.527095:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:1.0:1788744444.527105:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af72a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13856:x1875634047529600:12345-192.168.204.56@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788744444.527130:0:14306:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788744444.527146:0:14306:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788744444.527150:0:14306:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788744444.527154:0:14306:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788744444.527156:0:14306:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788744444.534245:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af72a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13856:x1875634047529600:12345-192.168.204.56@tcp:256:mount.lustre.0 Request processed in 7131us (7591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.534260:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 97 00000100:00100000:0.0:1788744444.548497:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.548812:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529728 00000100:00100000:2.0:1788744444.548824:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529728 00000100:00100000:2.0:1788744444.548888:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 98 00000100:00100000:2.0:1788744444.548898:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13856:x1875634047529728:12345-192.168.204.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788744444.548921:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744444.548944:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57615cd expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.548977:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.548989:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 13 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.549000:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dfa00, rc 0) 00000100:00100000:2.0:1788744444.549064:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13856:x1875634047529728:12345-192.168.204.56@tcp:101:mount.lustre.0 Request processed in 168us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.549072:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 98 00000100:00100000:3.0:1788744444.551903:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.552123:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529856 00000100:00100000:1.0:1788744444.552136:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529856 00000100:00100000:1.0:1788744444.552192:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 99 00000100:00100000:1.0:1788744444.552202:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13856:x1875634047529856:12345-192.168.204.56@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788744444.552540:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13856:x1875634047529856:12345-192.168.204.56@tcp:501:mount.lustre.0 Request processed in 339us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.552580:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 99 00000100:00100000:3.0:1788744444.555085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.555186:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047529984 00000100:00100000:0.0:1788744444.555196:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047529984 00000100:00100000:0.0:1788744444.555253:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 100 00000100:00100000:0.0:1788744444.555263:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13856:x1875634047529984:12345-192.168.204.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788744444.555532:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13856:x1875634047529984:12345-192.168.204.56@tcp:503:mount.lustre.0 Request processed in 269us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.555540:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 100 00000100:00100000:3.0:1788744444.559851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.561577:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530112 00000100:00100000:2.0:1788744444.561825:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530112 00000100:00100000:2.0:1788744444.561965:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 101 00000100:00100000:2.0:1788744444.561977:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13867:x1875634047530112:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788744444.562262:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13867:x1875634047530112:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 288us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.562270:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 101 00000100:00100000:3.0:1788744444.575970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.576133:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530240 00000100:00100000:1.0:1788744444.576145:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530240 00000100:00100000:1.0:1788744444.576209:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:1.0:1788744444.576220:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13867:x1875634047530240:12345-192.168.204.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788744444.576617:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13867:x1875634047530240:12345-192.168.204.56@tcp:502:llog_process_th.0 Request processed in 396us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.576627:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 102 00000100:00100000:3.0:1788744444.606172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744444.606225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744444.606263:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.606386:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530368 00000100:00100000:0.0:1788744444.606396:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530368 00000100:00100000:0.0:1788744444.606459:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530752 00000100:00100000:0.0:1788744444.606462:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530752 00000100:00100000:0.0:1788744444.606496:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744444.606508:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2351:x1875634047530752:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:0.0:1788744444.606629:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2351:x1875634047530752:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 124us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.606638:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744444.606659:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:0.0:1788744444.606669:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2350:x1875634047530368:12345-192.168.204.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788744444.606691:0:14313:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from c7cc926b-941e-4823-a2f7-075948338613@192.168.204.56@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:0.0:1788744444.606744:0:14313:0:(genops.c:1384:class_connect()) connect: client c7cc926b-941e-4823-a2f7-075948338613, cookie 0x7cd2bfd5e1b95a27 00000004:00100000:0.0:1788744444.606774:0:14313:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788744444.606922:0:14313:0:(import.c:65:import_set_state_nolock()) ffff9409c2486800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788744444.606953:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7cc926b-941e-4823-a2f7-075948338613+6:2350:x1875634047530368:12345-192.168.204.56@tcp:38:mount.lustre.0 Request processed in 282us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.606960:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:3.0:1788744444.608036:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.615983:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531008 00000100:00100000:1.0:1788744444.616017:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531008 00000100:00100000:1.0:1788744444.616080:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530880 00000100:00100000:1.0:1788744444.616084:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530880 00000100:00100000:1.0:1788744444.616107:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:1.0:1788744444.616116:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2351:x1875634047531008:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744444.616241:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2351:x1875634047531008:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 126us (9977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.616249:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:1.0:1788744444.616266:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:1.0:1788744444.616272:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2351:x1875634047530880:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744444.619657:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2351:x1875634047530880:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 23us (8264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.619695:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:2.0:1788744444.628747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.631882:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530496 00000100:00100000:0.0:1788744444.631898:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530496 00000100:00100000:0.0:1788744444.631992:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744444.632002:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7cc926b-941e-4823-a2f7-075948338613+6:0:x1875634047530496:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788744444.632033:0:14313:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788744444.632121:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7cc926b-941e-4823-a2f7-075948338613+6:0:x1875634047530496:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 120us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.632128:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00080000:3.0:1788744444.632213:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788744444.638228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.638340:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047530624 00000100:00100000:2.0:1788744444.638350:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047530624 00000100:00100000:2.0:1788744444.638428:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744444.638439:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047530624:12345-192.168.204.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788744444.638471:0:14312:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788744444.638579:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047530624:12345-192.168.204.56@tcp:41:mount.lustre.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.638587:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744444.644873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744444.647077:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531136 00000100:00100000:0.0:1788744444.647096:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531136 00000100:00100000:0.0:1788744444.647178:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:0.0:1788744444.647190:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047531136:12345-192.168.204.56@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788744444.647385:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047531136:12345-192.168.204.56@tcp:40:mount.lustre.0 Request processed in 197us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744444.647393:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:3.0:1788744444.651147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744444.651248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744444.651283:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744444.651374:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531264 00000100:00100000:1.0:1788744444.651384:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531264 00000100:00100000:1.0:1788744444.651435:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531392 00000100:00100000:1.0:1788744444.651437:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531392 00000100:00100000:1.0:1788744444.651452:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:1.0:1788744444.651461:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875634047531264:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788744444.651504:0:14996:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from c7cc926b-941e-4823-a2f7-075948338613@192.168.204.56@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1788744444.651577:0:14996:0:(genops.c:1384:class_connect()) connect: client c7cc926b-941e-4823-a2f7-075948338613, cookie 0x7cd2bfd5e1b95a2e 00002000:00100000:1.0:1788744444.651592:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c7cc926b-941e-4823-a2f7-075948338613/ffff940ac607a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744444.651613:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788744444.651767:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788744444.651800:0:14996:0:(import.c:65:import_set_state_nolock()) ffff940ac607f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744444.651874:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7cc926b-941e-4823-a2f7-075948338613+6:2350:x1875634047531264:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 412us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.651903:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:1.0:1788744444.651924:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:1.0:1788744444.651930:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875634047531392:12345-192.168.204.56@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788744444.651944:0:14996:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from c7cc926b-941e-4823-a2f7-075948338613@192.168.204.56@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:1.0:1788744444.651959:0:14996:0:(genops.c:1384:class_connect()) connect: client c7cc926b-941e-4823-a2f7-075948338613, cookie 0x7cd2bfd5e1b95a35 00002000:00100000:1.0:1788744444.651964:0:14996:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c7cc926b-941e-4823-a2f7-075948338613/ffff940ac6078800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788744444.651970:0:14996:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788744444.652153:0:14996:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788744444.652169:0:14996:0:(import.c:65:import_set_state_nolock()) ffff940ac6079000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788744444.652191:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c7cc926b-941e-4823-a2f7-075948338613+6:2350:x1875634047531392:12345-192.168.204.56@tcp:8:mount.lustre.0 Request processed in 261us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744444.652198:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744444.654482:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531520 00000100:00100000:2.0:1788744444.654497:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531520 00000100:00100000:2.0:1788744444.654646:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744444.654668:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047531520:12345-192.168.204.56@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788744444.655915:0:14315:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788744444.656034:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+6:13856:x1875634047531520:12345-192.168.204.56@tcp:33:mount.lustre.0 Request processed in 1374us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.656042:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:3.0:1788744444.889103:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744444.889218:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531648 00000100:00100000:2.0:1788744444.889229:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531648 00000100:00100000:2.0:1788744444.889323:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:2.0:1788744444.889334:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+6:13888:x1875634047531648:12345-192.168.204.56@tcp:101:mkdir.0 00010000:00010000:2.0:1788744444.889356:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744444.889382:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95a3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57615f7 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889460:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889475:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889502:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744444.889590:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744444.889593:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744444.889618:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889646:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95a3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889913:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744444.889923:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:2.0:1788744444.889926:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744444.889930:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df400, rc 0) 00000100:00100000:2.0:1788744444.889997:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+7:13888:x1875634047531648:12345-192.168.204.56@tcp:101:mkdir.0 Request processed in 665us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744444.890013:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00010000:00010000:3.0:1788744444.956808:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744445.978842:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744446.493974:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744446.493999:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068495232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788744446.494068:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744446.496461:0:15000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495232 00000100:00100000:0.0:1788744446.496487:0:15000:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495232 00000100:00100000:0.0:1788744446.496590:0:15000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788744446.496604:0:15000:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068495232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788744446.496785:0:15000:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744446.496878:0:15000:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875634068495232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (2810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744446.496893:0:15000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788744446.497272:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744446.498647:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875634068495232:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788744446.581108:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c7cc926b-941e-4823-a2f7-075948338613 00000001:00100000:1.0:1788744446.581130:0:6708:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 485aaa4b-4c98-4e00-ad7e-2419ecd72724 00010000:00010000:2.0:1788744447.010156:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788744447.069958:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c7cc926b-941e-4823-a2f7-075948338613 00000001:00100000:2.0:1788744447.069983:0:5858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 485aaa4b-4c98-4e00-ad7e-2419ecd72724 00000100:00100000:0.0:1788744447.514842:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744447.514866:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788744447.514934:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.516371:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068495488:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.516432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.516479:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068496000:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.516502:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.516525:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744447.516530:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068495616:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.516579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.516683:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496000 00000100:00100000:3.0:1788744447.516691:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496000 00000100:00100000:3.0:1788744447.517894:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744447.517916:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068496000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518010:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068496000:12345-0@lo:400:kworker.0 Request processed in 105us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744447.518018:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788744447.518056:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495616 00000100:00100000:3.0:1788744447.518065:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495616 00000100:00100000:3.0:1788744447.518098:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788744447.518105:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068495616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518137:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068495616:12345-0@lo:400:kworker.0 Request processed in 33us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744447.518143:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788744447.518159:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744447.518191:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068495872:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518233:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.518266:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788744447.518273:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068495744:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744447.518343:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495872 00000100:00100000:3.0:1788744447.518348:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495872 00000100:00100000:3.0:1788744447.518380:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495744 00000100:00100000:3.0:1788744447.518384:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495744 00000100:00100000:3.0:1788744447.518405:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744447.518411:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068495872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518448:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068495872:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744447.518454:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788744447.518482:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788744447.518488:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068495744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.518515:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068495744:12345-0@lo:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744447.518521:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788744447.518537:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788744447.518594:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068495744:0@lo:400:kworker.0 00000100:00100000:1.0:1788744447.524061:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495360 00000100:00100000:1.0:1788744447.524079:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495360 00000100:00100000:1.0:1788744447.524154:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788744447.524165:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068495360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788744447.524210:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744447.524301:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068495360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (9365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744447.524308:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788744447.526057:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068495872:0@lo:400:kworker.0 00000100:00080000:3.0:1788744447.526110:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788744447.526147:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788744447.526167:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068495360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744447.526197:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068495616:0@lo:400:kworker.0 00000100:00100000:3.0:1788744447.526211:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068496000:0@lo:400:kworker.0 00000100:00100000:2.0:1788744447.528247:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068495488 00000100:00100000:2.0:1788744447.528262:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068495488 00000100:00100000:2.0:1788744447.528340:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744447.528350:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068495488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744447.528449:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3312:x1875634068495488:12345-0@lo:400:kworker.0 Request processed in 101us (12017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744447.528468:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788744447.528700:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068495488:0@lo:400:kworker.0 00000001:00100000:2.0:1788744447.596649:0:7639:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c7cc926b-941e-4823-a2f7-075948338613 00000001:02000400:0.0:1788744447.915499:0:16277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788744448.029144:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744449.050920:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788744450.039927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.039964:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.039985:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.040005:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.040021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.040036:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.040065:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744450.040117:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531776 00000100:00100000:2.0:1788744450.040128:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531776 00000100:00100000:2.0:1788744450.040180:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 104 00000100:00100000:2.0:1788744450.040189:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2354:x1875634047531776:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.040268:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2354:x1875634047531776:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 79us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.040276:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 104 00000100:00100000:2.0:1788744450.040398:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532032 00000100:00100000:2.0:1788744450.040403:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532032 00000100:00100000:2.0:1788744450.040452:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532544 00000100:00100000:2.0:1788744450.040455:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532544 00000100:00100000:2.0:1788744450.040468:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532160 00000100:00100000:2.0:1788744450.040470:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532160 00000100:00100000:2.0:1788744450.040478:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532416 00000100:00100000:2.0:1788744450.040479:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532416 00000100:00100000:2.0:1788744450.040491:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:2.0:1788744450.041156:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047532032:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.041208:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047532032:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 710us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.041216:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:2.0:1788744450.041233:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:2.0:1788744450.041240:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047532544:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.041263:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047532544:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.041268:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:2.0:1788744450.041279:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:2.0:1788744450.041285:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047532160:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.041425:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047532160:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 139us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.041432:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:2.0:1788744450.041445:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744450.041451:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047532416:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.041473:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047532416:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 23us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.041478:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744450.041705:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532288 00000100:00100000:2.0:1788744450.041927:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532288 00000100:00100000:2.0:1788744450.041976:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047531904 00000100:00100000:2.0:1788744450.041980:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047531904 00000100:00100000:2.0:1788744450.042008:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744450.042015:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+6:2354:x1875634047532288:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.042051:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+6:2354:x1875634047532288:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 36us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.042057:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744450.042072:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744450.042078:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2354:x1875634047531904:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744450.042102:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2354:x1875634047531904:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744450.042108:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00080000:2.0:1788744450.044167:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788744450.044175:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744450.044178:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788744450.074887:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744451.099168:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744451.610833:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788744451.616717:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068496128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744451.616807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744451.616876:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496128 00000100:00100000:2.0:1788744451.616885:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496128 00000100:00100000:2.0:1788744451.616953:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744451.616963:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068496128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788744451.617005:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788744451.617053:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad31e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068496128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744451.617059:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788744451.617310:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788744451.617362:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068496128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788744452.123690:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788744452.245025:0:16426:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb805b8f0 20000000:00000080:0.0:1788744452.245049:0:16426:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff940ace596000 uarg=0000000000000000 20000000:01000000:0.0:1788744452.245093:0:16426:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788744452.245099:0:16426:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788744452.245105:0:16426:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788744452.250204:0:16427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788744452.254347:0:16426:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788744452.271200:0:16426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788744452.273215:0:16426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273257:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273266:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273274:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273286:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273295:0:16426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273303:0:16426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273358:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273387:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 12 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.273403:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496256:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744452.273574:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273583:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 12 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.273599:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496384:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744452.273631:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.273639:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 18 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.273648:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496512:0@lo:104: 00000100:00100000:3.0:1788744452.275032:0:16426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744452.275145:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.275164:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 18 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.275181:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496640:0@lo:104: 00000100:00100000:3.0:1788744452.275238:0:16426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788744452.275264:0:16426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 18 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.275271:0:16426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 18 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.275279:0:16426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496768:0@lo:104: 00000100:00100000:3.0:1788744452.275303:0:16426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744452.275313:0:16426:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2f24e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788744452.275625:0:14294:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788744452.275646:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496512 00000100:00100000:0.0:1788744452.275659:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496512 00000100:00100000:0.0:1788744452.275793:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496640 00000100:00100000:0.0:1788744452.275797:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496640 00000100:00100000:0.0:1788744452.275808:0:14294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496768 00000100:00100000:0.0:1788744452.275810:0:14294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496768 00000100:00100000:0.0:1788744452.275826:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744452.275836:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:16426:x1875634068496512:12345-0@lo:104: 00010000:00010000:0.0:1788744452.275868:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.275945:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788744452.275952:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+5:16426:x1875634068496512:12345-0@lo:104: Request processed in 118us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.275959:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744452.275981:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744452.275988:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+4:16426:x1875634068496640:12345-0@lo:104: 00010000:00010000:0.0:1788744452.275996:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276030:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788744452.276035:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+4:16426:x1875634068496640:12345-0@lo:104: Request processed in 49us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.276041:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744452.276054:0:14294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744452.276060:0:14294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ad3601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:16426:x1875634068496768:12345-0@lo:104: 00010000:00010000:0.0:1788744452.276067:0:14294:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276094:0:14294:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788744452.276099:0:14294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ad3601050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+3:16426:x1875634068496768:12345-0@lo:104: Request processed in 40us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.276105:0:14294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788744452.276148:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788744452.276155:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276170:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af7388a00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744452.276175:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276182:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744452.276191:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744452.276197:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744452.276231:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276237:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744452.276265:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276272:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af7388a00/0x7cd2bfd5e1b958bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b958c2 expref: -99 pid: 15716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276287:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788744452.276291:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276297:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76a00 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744452.276299:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276319:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744452.276326:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744452.276331:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744452.276346:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276352:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788744452.276358:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276377:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940afaa76a00/0x7cd2bfd5e1b95787 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b9578e expref: -99 pid: 14995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276386:0:14300:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788744452.276389:0:14300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276395:0:14300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1acec20) 10000000:00010000:0.0:1788744452.276398:0:14300:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276406:0:14300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788744452.276412:0:14300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744452.276422:0:14300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788744452.276436:0:14300:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.276443:0:14300:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788744452.278007:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496512:0@lo:104: 00000100:00100000:3.0:1788744452.278023:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496640:0@lo:104: 00000100:00100000:3.0:1788744452.278047:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496768:0@lo:104: 00010000:00010000:0.0:1788744452.278139:0:14300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.278154:0:14300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.156@tcp lock: ffff940af73d2000/0x7cd2bfd5e1b9573a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7cd2bfd5e1b95741 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.278174:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744452.278176:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788744452.278178:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744452.278196:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3310:1875634068496896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744452.278265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744452.278321:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788744452.278328:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3310:1875634068497024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744452.278351:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744452.278394:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068497152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744452.278419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744452.278448:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068496896 00000100:00100000:0.0:1788744452.278456:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068496896 00010000:00010000:0.0:1788744452.278489:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 19 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744452.278509:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497024 00000100:00100000:0.0:1788744452.278511:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497024 00010000:00010000:0.0:1788744452.278530:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 20 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744452.278541:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497152 00000100:00100000:0.0:1788744452.278544:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497152 00010000:00010000:0.0:1788744452.278572:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 21 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744452.278587:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744452.278596:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+21:3310:x1875634068496896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744452.278610:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744452.278617:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 21 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.278627:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 21 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.278645:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940afaa77e00/0x7cd2bfd5e1b958c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b958bb expref: 21 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.278659:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744452.280901:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+20:3310:x1875634068496896:12345-0@lo:103:ldlm_bl.0 Request processed in 2295us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.280917:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788744452.280967:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744452.280982:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3310:x1875634068497024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744452.281005:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744452.281016:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 19 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281054:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 19 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281077:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d3400/0x7cd2bfd5e1b9578e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b95787 expref: 19 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281097:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744452.281143:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:3310:x1875634068497024:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.281149:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788744452.281164:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788744452.281171:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afb61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:3312:x1875634068497152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788744452.281180:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744452.281185:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 17 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281194:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 17 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281204:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af7388800/0x7cd2bfd5e1b95741 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7cd2bfd5e1b9573a expref: 17 pid: 14305 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744452.281215:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744452.281248:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afb61fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:3312:x1875634068497152:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.281255:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788744452.282133:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3312:1875634068497152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744452.283617:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3310:1875634068497024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788744452.283631:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ad31e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3310:1875634068496896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788744452.284070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744452.284275:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532672 00000100:00100000:1.0:1788744452.284284:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532672 00010000:00010000:1.0:1788744452.284322:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744452.284358:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:1.0:1788744452.284378:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047532672:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744452.284393:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744452.284400:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.284413:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.284435:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744452.284500:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047532672:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 132us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744452.284508:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00010000:00010000:2.0:1788744452.285056:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788744452.285146:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744452.286833:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532800 00000100:00100000:1.0:1788744452.286850:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532800 00010000:00010000:1.0:1788744452.286905:0:14296:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744452.286959:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:1.0:1788744452.286969:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047532800:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744452.286986:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744452.286992:0:14296:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287024:0:14296:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 13 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287050:0:14296:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287059:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287076:0:14296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287084:0:14296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287091:0:14296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287099:0:14296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287106:0:14296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cbe00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:1.0:1788744452.287110:0:14296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287118:0:14296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287125:0:14296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744452.287144:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744452.287214:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047532800:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 246us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744452.287221:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00010000:00010000:3.0:1788744452.290063:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615cd expref: 12 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.290088:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496256:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744452.290101:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940af73d2200/0x7cd2bfd5e1b959e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576156b expref: 11 pid: 14304 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744452.290112:0:16426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940afa5cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16426:1875634068496384:192.168.204.56@tcp:104: 00010000:00010000:3.0:1788744452.290172:0:16426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.290183:0:16426:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.290190:0:16426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744452.290197:0:16426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a4a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744452.444282:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788744452.634980:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068497280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744452.635058:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744452.635183:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497280 00000100:00100000:0.0:1788744452.635193:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497280 00000100:00100000:0.0:1788744452.635256:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744452.635265:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068497280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788744452.635303:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788744452.635349:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875634068497280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.635368:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788744452.635415:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875634068497280:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788744452.635750:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744452.636000:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068497792:0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.636040:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744452.636063:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788744452.636070:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068497664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.636096:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744452.636123:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497792 00000100:00100000:2.0:1788744452.636128:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497792 00000100:00100000:2.0:1788744452.636165:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497664 00000100:00100000:2.0:1788744452.636168:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497664 00000100:00100000:2.0:1788744452.636187:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744452.636194:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068497792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.636234:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875634068497792:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744452.636241:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788744452.636257:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788744452.636263:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068497664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.636300:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875634068497664:12345-0@lo:400:kworker.0 Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744452.636306:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788744452.636332:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744452.636352:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875634068497664:0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.636377:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875634068497792:0@lo:400:kworker.0 00000100:00100000:3.0:1788744452.636470:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068497408:0@lo:400:kworker.0 00000100:00100000:3.0:1788744452.636504:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744452.636531:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788744452.636537:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068497536:0@lo:400:kworker.0 00000100:00100000:3.0:1788744452.636582:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744452.637224:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497408 00000100:00100000:2.0:1788744452.637231:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497408 00000100:00100000:2.0:1788744452.637315:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788744452.637324:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068497408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788744452.637399:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068497408:12345-0@lo:400:kworker.0 Request processed in 77us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744452.637407:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788744452.637475:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068497408:0@lo:400:kworker.0 00000100:00100000:0.0:1788744452.637957:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497536 00000100:00100000:0.0:1788744452.637963:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497536 00000100:00100000:0.0:1788744452.637996:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744452.638003:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068497536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788744452.638049:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875634068497536:12345-0@lo:400:kworker.0 Request processed in 46us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744452.638055:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788744452.638091:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875634068497536:0@lo:400:kworker.0 00010000:00010000:3.0:1788744453.150041:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788744453.468618:0:14308:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744453.468630:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ad8468800 from 10 10000000:01000000:1.0:1788744453.468637:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744453.468699:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.468714:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.468726:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744453.468761:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068497920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.468856:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744453.468926:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d67180 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.469245:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068497920 00000100:00100000:2.0:1788744453.469254:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068497920 00000100:00100000:2.0:1788744453.469311:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744453.469324:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+16:14308:x1875634068497920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.469355:0:14306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744453.469375:0:14306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24df200/0x7cd2bfd5e1b95a58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95a51 expref: -99 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.469403:0:14306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24df200/0x7cd2bfd5e1b95a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a51 expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.469415:0:14306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24df200/0x7cd2bfd5e1b95a58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a51 expref: 17 pid: 14306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.469459:0:14306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df200, rc 0) 00000100:00100000:2.0:1788744453.469687:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7704c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:14308:x1875634068497920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 367us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.469695:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788744453.469756:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068497920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.469774:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a58 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.469783:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95a58 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744453.469851:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.469881:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744453.469911:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.469927:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498048 00000100:00100000:2.0:1788744453.469931:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498048 00000100:00100000:1.0:1788744453.471464:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788744453.471506:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:14308:x1875634068498048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744453.472271:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788744453.472364:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788744453.472431:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744453.472466:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.472691:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498176 00000100:00100000:2.0:1788744453.472702:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498176 00000100:00100000:2.0:1788744453.472743:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788744453.472751:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.472938:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.472947:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788744453.474248:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:14308:x1875634068498048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 475us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744453.474263:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788744453.475708:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744453.483612:0:16464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788744453.483936:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788744453.483968:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788744453.483979:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a58 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.484005:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d3000/0x7cd2bfd5e1b95a51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a58 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788744453.484016:0:14308:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788744453.484019:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9409c214b000 from 10 10000000:01000000:1.0:1788744453.484021:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788744453.484067:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.484074:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.484085:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744453.484111:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.484187:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744453.484237:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.485159:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498304 00000100:00100000:2.0:1788744453.485171:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498304 00000100:00100000:2.0:1788744453.485254:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788744453.485264:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+17:14308:x1875634068498304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.485283:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744453.485301:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24dec00/0x7cd2bfd5e1b95a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95a5f expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.485332:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24dec00/0x7cd2bfd5e1b95a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a5f expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.485356:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24dec00/0x7cd2bfd5e1b95a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a5f expref: 18 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.485366:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dec00, rc 0) 00000100:00100000:2.0:1788744453.485437:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.485456:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788744453.485692:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788744453.485710:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a66 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744453.485719:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95a66 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744453.485787:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.485824:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744453.485867:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d673c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.485937:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498432 00000100:00100000:2.0:1788744453.485943:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498432 00000100:00100000:2.0:1788744453.485992:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788744453.486001:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.488313:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2304us (2479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.488327:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788744453.488456:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.488526:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.488608:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744453.488650:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498560 00000100:00100000:1.0:1788744453.488653:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788744453.488659:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498560 00000100:00100000:3.0:1788744453.488704:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788744453.488713:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788744453.488870:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744453.488877:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788744453.489751:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788744453.490692:0:16465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788744453.491013:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788744453.491043:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788744453.491054:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a66 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744453.491068:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940af73d3400/0x7cd2bfd5e1b95a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a66 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788744453.491079:0:14308:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788744453.491081:0:14308:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff940ac2d3a000 from 10 10000000:01000000:0.0:1788744453.491084:0:14308:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788744453.491121:0:14308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744453.491129:0:14308:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744453.491139:0:14308:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744453.491162:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788744453.491225:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788744453.491725:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.491731:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498688 00000100:00100000:2.0:1788744453.491739:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498688 00000100:00100000:2.0:1788744453.491792:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788744453.491801:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+18:14308:x1875634068498688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.491814:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744453.491836:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24de800/0x7cd2bfd5e1b95a74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7cd2bfd5e1b95a6d expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.491860:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24de800/0x7cd2bfd5e1b95a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a6d expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.491869:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24de800/0x7cd2bfd5e1b95a74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7cd2bfd5e1b95a6d expref: 19 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.491877:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24de800, rc 0) 00000100:00100000:2.0:1788744453.491921:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7705450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068498688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.491928:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788744453.491983:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.491997:0:14308:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a74 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.492006:0:14308:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7cd2bfd5e1b95a74 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744453.492072:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.492103:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744453.492118:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.492131:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498816 00000100:00100000:2.0:1788744453.492134:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498816 00000100:00100000:2.0:1788744453.492156:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744453.492162:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068498816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.492427:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7706c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068498816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.492456:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788744453.492504:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.492536:0:14308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.492603:0:14308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744453.492626:0:14308:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad1d543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788744453.492638:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068498944 00000100:00100000:2.0:1788744453.492641:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068498944 00000100:00100000:2.0:1788744453.492663:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788744453.492669:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af7707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068498944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.492812:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af7707850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:14308:x1875634068498944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.492819:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788744453.492859:0:14308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:14308:1875634068498944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788744453.493492:0:16467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788744453.493584:0:14308:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788744453.493605:0:14308:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788744453.493616:0:14308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a74 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.493626:0:14308:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.156@tcp lock: ffff940afaa77e00/0x7cd2bfd5e1b95a6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7cd2bfd5e1b95a74 expref: -99 pid: 14308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744453.932495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744453.933720:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047532928 00000100:00100000:2.0:1788744453.933736:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047532928 00000100:00100000:2.0:1788744453.933817:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:2.0:1788744453.933829:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+11:13743:x1875634047532928:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788744453.933859:0:14304:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744453.933881:0:14304:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9409c24dee00/0x7cd2bfd5e1b95a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb57615fe expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.933917:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9409c24dee00/0x7cd2bfd5e1b95a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615fe expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.933930:0:14304:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9409c24dee00/0x7cd2bfd5e1b95a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615fe expref: 12 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744453.933940:0:14304:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dee00, rc 0) 00000100:00100000:2.0:1788744453.934025:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047532928:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 199us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.934033:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 114 00000100:00100000:2.0:1788744453.940999:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744453.941698:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533056 00000100:00100000:1.0:1788744453.941709:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533056 00000100:00100000:1.0:1788744453.941766:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:1.0:1788744453.941776:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047533056:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.942079:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047533056:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 302us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744453.942088:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 115 00000100:00100000:3.0:1788744453.954367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744453.961207:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533184 00000100:00100000:2.0:1788744453.961223:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533184 00000100:00100000:2.0:1788744453.961304:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 116 00000100:00100000:2.0:1788744453.961316:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047533184:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.961617:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047533184:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 301us (7259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.961627:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 116 00000100:00100000:1.0:1788744453.983311:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744453.987907:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533312 00000100:00100000:3.0:1788744453.987927:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533312 00000100:00100000:3.0:1788744453.987993:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:3.0:1788744453.988004:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+12:13743:x1875634047533312:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788744453.988024:0:14305:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744453.988048:0:14305:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761605 expref: -99 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744453.988084:0:14305:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761605 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744453.988097:0:14305:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff940ac29cbe00/0x7cd2bfd5e1b95a82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761605 expref: 13 pid: 14305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744453.988119:0:14305:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29cbe00, rc 0) 00000100:00100000:3.0:1788744453.988194:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13743:x1875634047533312:12345-192.168.204.56@tcp:101:ll_cfg_requeue.0 Request processed in 192us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744453.988201:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 117 00000100:00100000:2.0:1788744453.992292:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744453.992381:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533440 00000100:00100000:1.0:1788744453.992391:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533440 00000100:00100000:1.0:1788744453.992448:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:1.0:1788744453.992459:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13743:x1875634047533440:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788744453.992784:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13743:x1875634047533440:12345-192.168.204.56@tcp:501:ll_cfg_requeue.0 Request processed in 326us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744453.992792:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 118 00000100:00100000:1.0:1788744453.995300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744453.995496:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533568 00000100:00100000:2.0:1788744453.995509:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533568 00000100:00100000:2.0:1788744453.995586:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 119 00000100:00100000:2.0:1788744453.995600:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13743:x1875634047533568:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788744453.995876:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:13743:x1875634047533568:12345-192.168.204.56@tcp:503:ll_cfg_requeue.0 Request processed in 278us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744453.995884:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 119 00010000:00010000:2.0:1788744454.172291:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744455.149776:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744455.149828:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744455.149866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744455.149898:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533696 00000100:00100000:2.0:1788744455.149915:0:14305:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533696 00000100:00100000:1.0:1788744455.149924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744455.149948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744455.149979:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:1.0:1788744455.149985:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744455.149997:0:14305:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047533696:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744455.150017:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744455.150037:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534208 00000100:00100000:1.0:1788744455.150042:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534208 00000100:00100000:2.0:1788744455.150083:0:14305:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047533696:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744455.150088:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533824 00000100:00100000:1.0:1788744455.150092:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533824 00000100:00100000:2.0:1788744455.150093:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 120 00000100:00100000:1.0:1788744455.150122:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:1.0:1788744455.150132:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+6:2353:x1875634047534208:12345-192.168.204.56@tcp:400:kworker.0 00000100:00080000:2.0:1788744455.150162:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744455.150171:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+6:2353:x1875634047534208:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 40us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744455.150176:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047533952 00000100:00100000:1.0:1788744455.150181:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:1.0:1788744455.150199:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:1.0:1788744455.150205:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2353:x1875634047533824:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744455.150229:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2353:x1875634047533824:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744455.150235:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:3.0:1788744455.150291:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534464 00000100:00100000:3.0:1788744455.150297:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534464 00000100:00100000:3.0:1788744455.150353:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534080 00000100:00100000:3.0:1788744455.150357:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534080 00000100:00100000:3.0:1788744455.150374:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534336 00000100:00100000:3.0:1788744455.150377:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534336 00000100:00100000:3.0:1788744455.150396:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:3.0:1788744455.150404:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047534464:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:1.0:1788744455.150413:0:14996:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788744455.150424:0:14996:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788744455.150447:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047534464:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744455.150454:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:3.0:1788744455.150476:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744455.150483:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047534080:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744455.150510:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047534080:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744455.150516:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:3.0:1788744455.150531:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:3.0:1788744455.150539:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047534336:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744455.150599:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047534336:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 61us (582us total) trans 0 rc 0/0 00000100:00080000:1.0:1788744455.150614:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744455.150619:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00080000:1.0:1788744455.150622:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788744455.151658:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047533952 00000100:00080000:1.0:1788744455.151721:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788744455.152365:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:2.0:1788744455.152382:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047533952:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744455.152472:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047533952:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 96us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744455.152481:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00010000:00010000:3.0:1788744455.195037:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744456.090490:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.090618:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534592 00000100:00100000:2.0:1788744456.090630:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534592 00000100:00100000:2.0:1788744456.090694:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:2.0:1788744456.090705:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:14398:x1875634047534592:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788744456.090732:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.090757:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95a89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576160c expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090859:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090877:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090895:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090912:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090920:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.090927:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091315:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df800/0x7cd2bfd5e1b95a9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091325:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df800/0x7cd2bfd5e1b95a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091333:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df800/0x7cd2bfd5e1b95a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.091361:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744456.091365:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744456.091401:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df800/0x7cd2bfd5e1b95a9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091423:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091429:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091436:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091443:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.091448:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091456:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091470:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:2.0:1788744456.091473:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.091478:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091485:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95a90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091497:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091504:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091510:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091521:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dfa00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.091524:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091530:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.091539:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff940ad0017400) 00010000:00010000:2.0:1788744456.091541:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.091544:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.092223:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95a97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.092272:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95a89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576160c expref: 8 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.092286:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df800/0x7cd2bfd5e1b95a9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576160c expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.092305:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ad0017800) 00010000:00010000:2.0:1788744456.092307:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744456.092310:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df800, rc 0) 00000100:00100000:2.0:1788744456.092436:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:14398:x1875634047534592:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 1732us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.092446:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 15 00000100:00100000:0.0:1788744456.105018:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744456.106759:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534848 00000100:00100000:3.0:1788744456.106778:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534848 00000100:00100000:3.0:1788744456.106882:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:3.0:1788744456.106893:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:14398:x1875634047534848:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744456.106921:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744456.106945:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95aa5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761613 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107020:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107039:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107052:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107135:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107144:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.107151:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108046:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca200/0x7cd2bfd5e1b95aba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108084:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca200/0x7cd2bfd5e1b95aba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108091:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca200/0x7cd2bfd5e1b95aba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788744456.108103:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788744456.108308:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108317:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108323:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108329:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744456.108334:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108341:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108354:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff940ad0017800) 00010000:00010000:3.0:1788744456.108357:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744456.108361:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108367:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95aac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108390:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108402:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108408:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108413:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744456.108416:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108422:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108429:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff940ad0012700) 00010000:00010000:3.0:1788744456.108431:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744456.108433:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.108765:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95ab3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.109927:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95aa5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761613 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.109953:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca200/0x7cd2bfd5e1b95aba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761613 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.109962:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ad0012200) 00010000:00010000:3.0:1788744456.109964:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788744456.109974:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29ca200, rc 0) 00000100:00100000:3.0:1788744456.110252:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14398:x1875634047534848:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 3360us (5245us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788744456.110262:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744456.129496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.130618:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047534976 00000100:00100000:1.0:1788744456.130635:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047534976 00000100:00100000:1.0:1788744456.130727:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:1.0:1788744456.130740:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14398:x1875634047534976:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788744456.130894:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14398:x1875634047534976:12345-192.168.204.56@tcp:59:lhsmtool_posix.0 Request processed in 157us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744456.130902:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:0.0:1788744456.173942:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.174131:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535104 00000100:00100000:2.0:1788744456.174166:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535104 00000100:00100000:2.0:1788744456.174301:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744456.174313:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14404:x1875634047535104:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744456.174338:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.174365:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95ac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576161a expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174473:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174491:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174505:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174521:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174529:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.174536:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175065:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175074:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175081:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175093:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dfa00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.175098:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175104:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175119:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:2.0:1788744456.175122:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.175126:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175132:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95acf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175144:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175149:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175155:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175159:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.175162:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175167:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175183:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff940ad0017400) 00010000:00010000:2.0:1788744456.175185:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.175189:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175194:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ad6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175233:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95ac8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576161a expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175245:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:2.0:1788744456.175247:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.175251:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95ac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576161a expref: 10 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.175261:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dfc00, rc 0) 00000100:00100000:2.0:1788744456.175418:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14404:x1875634047535104:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1106us (1489us total) trans 0 rc 301/301 00000100:00100000:2.0:1788744456.175427:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:0.0:1788744456.181343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.181578:0:14320:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535232 00000100:00100000:1.0:1788744456.181591:0:14320:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535232 00000100:00100000:1.0:1788744456.181645:0:14320:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:1.0:1788744456.181656:0:14320:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14404:x1875634047535232:12345-192.168.204.56@tcp:700:lfs.0 00000100:00100000:1.0:1788744456.182008:0:14320:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14404:x1875634047535232:12345-192.168.204.56@tcp:700:lfs.0 Request processed in 352us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744456.182015:0:14320:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:0.0:1788744456.184809:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.185391:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535488 00000100:00100000:1.0:1788744456.185405:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535488 00000100:00100000:1.0:1788744456.185487:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:1.0:1788744456.185498:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14404:x1875634047535488:12345-192.168.204.56@tcp:36:lfs.0 00010000:00010000:1.0:1788744456.185619:0:15478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744456.185660:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cbc00/0x7cd2bfd5e1b95a0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761595 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.185694:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:1.0:1788744456.185700:0:15478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744456.185980:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.185994:0:15478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 5 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.186015:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.186049:0:15478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 5 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.186065:0:15478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 5 pid: 14311 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744456.186079:0:15478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940b00b73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15478:1875634068499072:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744456.186172:0:15478:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ac7d670c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788744456.191784:0:15478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940b00b73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15478:1875634068499072:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744456.191815:0:15478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744456.192110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.192191:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535616 00000100:00100000:0.0:1788744456.192199:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535616 00010000:00010000:0.0:1788744456.192238:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 6 pid: 14311 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744456.192301:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:0.0:1788744456.192312:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7cc926b-941e-4823-a2f7-075948338613+6:2353:x1875634047535616:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744456.192329:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744456.192336:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 6 pid: 14311 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192349:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 6 pid: 14311 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192372:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95a43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57615f7 expref: 6 pid: 14311 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192390:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:0.0:1788744456.192396:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192407:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192415:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.192455:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744456.192520:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047535616:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 210us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744456.192528:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00010000:00010000:2.0:1788744456.193174:0:15478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.193184:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.193210:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.193229:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.193239:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.196095:0:15478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788744456.196118:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196132:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196141:0:15478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196147:0:15478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.196152:0:15478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196160:0:15478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196180:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0012a00) 00010000:00010000:2.0:1788744456.196183:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.196188:0:15478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.196195:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95add lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788744456.196235:0:15478:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b1b43a53 reply state 00000000e73e581d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744456.196245:0:15478:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788744456.196408:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+10:14404:x1875634047535488:12345-192.168.204.56@tcp:36:lfs.0 Request processed in 10907us (11606us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788744456.196418:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00010000:00010000:1.0:1788744456.207568:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207586:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207595:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207602:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744456.207607:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207637:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207654:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff940ad0017400) 00010000:00010000:1.0:1788744456.207657:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744456.207662:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.207669:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ae4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.222165:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788744456.302223:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.302488:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535744 00000100:00100000:2.0:1788744456.302499:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535744 00000100:00100000:2.0:1788744456.302653:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744456.302666:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:14412:x1875634047535744:12345-192.168.204.56@tcp:101:lctl.0 00010000:00010000:2.0:1788744456.302698:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.302726:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95aeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761621 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302796:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfe00/0x7cd2bfd5e1b95af2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302812:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfe00/0x7cd2bfd5e1b95af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302824:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfe00/0x7cd2bfd5e1b95af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.302863:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744456.302868:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744456.302910:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfe00/0x7cd2bfd5e1b95af2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302955:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95aeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761621 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302973:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfe00/0x7cd2bfd5e1b95af2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761621 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.302981:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:2.0:1788744456.302985:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744456.302989:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dfe00, rc 0) 00000100:00100000:2.0:1788744456.303072:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+10:14412:x1875634047535744:12345-192.168.204.56@tcp:101:lctl.0 Request processed in 407us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.303080:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:0.0:1788744456.329797:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.329977:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047535872 00000100:00100000:2.0:1788744456.329988:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047535872 00000100:00100000:2.0:1788744456.330050:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:2.0:1788744456.330060:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+5:14413:x1875634047535872:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744456.330243:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.330262:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761628 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330339:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de200/0x7cd2bfd5e1b95b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330353:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de200/0x7cd2bfd5e1b95b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330363:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de200/0x7cd2bfd5e1b95b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.330461:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744456.330465:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744456.330484:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de200/0x7cd2bfd5e1b95b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330507:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761628 expref: 7 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330524:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de200/0x7cd2bfd5e1b95b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761628 expref: 6 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.330533:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:2.0:1788744456.330536:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788744456.330539:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24de200, rc 0) 00000100:00100000:2.0:1788744456.330643:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c7cc926b-941e-4823-a2f7-075948338613+6:14413:x1875634047535872:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 584us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.330650:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 21 00000100:00100000:1.0:1788744456.333680:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.333772:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047536000 00000100:00100000:0.0:1788744456.333781:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047536000 00000100:00100000:0.0:1788744456.333835:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:0.0:1788744456.333845:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+6:14413:x1875634047536000:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744456.333868:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744456.333888:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95b07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576162f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.333964:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.333979:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.333991:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334005:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334013:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334019:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334182:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334190:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334218:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744456.334252:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744456.334256:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744456.334274:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334297:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334303:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334309:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334315:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744456.334319:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334327:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334339:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:0.0:1788744456.334342:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744456.334348:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334353:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334377:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334383:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334389:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334394:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744456.334397:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334403:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334411:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff940ad90af200) 00010000:00010000:0.0:1788744456.334413:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744456.334416:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334424:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334456:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76200/0x7cd2bfd5e1b95b07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576162f expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334469:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576162f expref: 7 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.334487:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:0.0:1788744456.334489:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744456.334491:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76800, rc 0) 00000100:00100000:0.0:1788744456.334598:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+7:14413:x1875634047536000:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 753us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744456.334606:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 22 00000100:00100000:0.0:1788744456.343696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.344227:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047536256 00000100:00100000:1.0:1788744456.344242:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047536256 00000100:00100000:1.0:1788744456.344320:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:1.0:1788744456.344332:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+7:14413:x1875634047536256:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744456.344357:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744456.344379:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761636 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744456.344487:0:15478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788744456.344658:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761636 expref: 9 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.344673:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:1.0:1788744456.344677:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744456.344682:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761636 expref: 9 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.344943:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2400, rc 0) 00000100:00100000:1.0:1788744456.345184:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+8:14413:x1875634047536256:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 853us (1499us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788744456.345192:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 23 00000100:00100000:1.0:1788744456.348468:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.348599:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047536512 00000100:00100000:0.0:1788744456.348610:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047536512 00000100:00100000:0.0:1788744456.348668:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:0.0:1788744456.348678:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+8:14413:x1875634047536512:12345-192.168.204.56@tcp:36:lfs.0 00010000:00010000:0.0:1788744456.348734:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744456.348760:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76800/0x7cd2bfd5e1b95b1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576162f expref: 8 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.348779:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:0.0:1788744456.348789:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788744456.348813:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.348828:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.348838:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788744456.349061:0:14312:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000002ef6722 reply state 00000000881440c8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744456.349084:0:14312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788744456.349095:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788744456.349193:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+9:14413:x1875634047536512:12345-192.168.204.56@tcp:36:lfs.0 Request processed in 514us (734us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788744456.349201:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 24 00000100:00100000:0.0:1788744456.353652:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.353750:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047536768 00000100:00100000:2.0:1788744456.353760:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047536768 00000100:00100000:2.0:1788744456.353825:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744456.353838:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+9:14413:x1875634047536768:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744456.354110:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+10:14413:x1875634047536768:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 273us (468us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788744456.354118:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00010000:00010000:3.0:1788744456.355616:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355632:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355656:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355663:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76a00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:3.0:1788744456.355667:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355674:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355689:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af200) 00010000:00010000:3.0:1788744456.355692:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788744456.355697:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744456.355703:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76a00/0x7cd2bfd5e1b95b31 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744456.361303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.361418:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537024 00000100:00100000:1.0:1788744456.361430:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537024 00000100:00100000:1.0:1788744456.361516:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:1.0:1788744456.361529:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+9:14413:x1875634047537024:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:1.0:1788744456.361596:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744456.361624:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b95b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576163d expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362012:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362029:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362044:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362061:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362068:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362096:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744456.362219:0:15478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788744456.362333:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362342:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362349:0:15478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362355:0:15478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744456.362360:0:15478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362368:0:15478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362390:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:1.0:1788744456.362393:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744456.362399:0:15478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362406:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95b3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.362419:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363750:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363766:0:15478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363771:0:15478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744456.363776:0:15478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363783:0:15478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363798:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff940ac3570300) 00010000:00010000:1.0:1788744456.363801:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744456.363806:0:15478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363812:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95b46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363905:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b95b38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576163d expref: 11 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363919:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:1.0:1788744456.363921:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744456.363925:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3e00/0x7cd2bfd5e1b95b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576163d expref: 11 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.363956:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3e00, rc 0) 00000100:00100000:1.0:1788744456.364044:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+10:14413:x1875634047537024:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 2516us (2764us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788744456.364053:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 25 00000100:00100000:1.0:1788744456.367836:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.368504:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537152 00000100:00100000:0.0:1788744456.368519:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537152 00000100:00100000:0.0:1788744456.368636:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:0.0:1788744456.368648:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+10:14413:x1875634047537152:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:0.0:1788744456.368681:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744456.368708:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b54 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761644 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.368850:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.368865:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.368879:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744456.368909:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788744456.368913:0:14312:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744456.368937:0:14312:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.368979:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77c00/0x7cd2bfd5e1b95b54 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 12 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.369000:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.369010:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:0.0:1788744456.369014:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788744456.369019:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa77600, rc 0) 00000100:00100000:0.0:1788744456.369112:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c7cc926b-941e-4823-a2f7-075948338613+11:14413:x1875634047537152:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 466us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744456.369119:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 26 00000100:00100000:0.0:1788744456.377173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.377356:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537280 00000100:00100000:2.0:1788744456.377368:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537280 00000100:00100000:2.0:1788744456.377466:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:2.0:1788744456.377477:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+11:14413:x1875634047537280:12345-192.168.204.56@tcp:37:lfs.0 00000100:00100000:2.0:1788744456.381815:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c7cc926b-941e-4823-a2f7-075948338613+11:14413:x1875634047537280:12345-192.168.204.56@tcp:37:lfs.0 Request processed in 4328us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.381831:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:1.0:1788744456.387352:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.387621:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537536 00000100:00100000:0.0:1788744456.387632:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537536 00000100:00100000:0.0:1788744456.387786:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:0.0:1788744456.387797:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace6a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7cc926b-941e-4823-a2f7-075948338613+11:14413:x1875634047537536:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:0.0:1788744456.388046:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace6a7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c7cc926b-941e-4823-a2f7-075948338613+12:14413:x1875634047537536:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 249us (706us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788744456.388058:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:0.0:1788744456.452448:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.452604:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537664 00000100:00100000:2.0:1788744456.452616:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537664 00000100:00100000:2.0:1788744456.452681:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:2.0:1788744456.452692:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+10:14419:x1875634047537664:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744456.452717:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.452741:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576164b expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452811:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452828:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452840:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452857:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452864:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.452869:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453009:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95b77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453020:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453027:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.453064:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788744456.453068:0:14311:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744456.453116:0:14311:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95b77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453130:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453137:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453144:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453151:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24de000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.453155:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453161:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453174:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:2.0:1788744456.453183:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.453189:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453196:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453218:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453224:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453229:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453234:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.453236:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453242:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453249:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff940ad0017e00) 00010000:00010000:2.0:1788744456.453252:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744456.453255:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453261:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95b70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453307:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576164b expref: 12 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453331:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df400/0x7cd2bfd5e1b95b77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576164b expref: 11 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.453339:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:2.0:1788744456.453341:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788744456.453343:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df400, rc 0) 00000100:00100000:2.0:1788744456.454264:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14419:x1875634047537664:12345-192.168.204.56@tcp:101:bash.0 Request processed in 1569us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.454274:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 27 00000100:00100000:3.0:1788744456.458159:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.458541:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047537920 00000100:00100000:0.0:1788744456.458832:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047537920 00000100:00100000:0.0:1788744456.458928:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 28 00000100:00100000:0.0:1788744456.458939:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14419:x1875634047537920:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:0.0:1788744456.458983:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744456.459006:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95b7e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761652 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.459129:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.459145:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.459154:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.459188:0:14312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 11 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.459200:0:14312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 11 pid: 14312 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744456.459213:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068499200:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744456.459320:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff940acedc0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788744456.464313:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068499200:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744456.464348:0:14312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744456.464809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.466346:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047538048 00000100:00100000:0.0:1788744456.466365:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047538048 00010000:00010000:0.0:1788744456.466458:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 12 pid: 14312 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744456.466596:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:0.0:1788744456.466609:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7cc926b-941e-4823-a2f7-075948338613+12:2354:x1875634047538048:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788744456.466630:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788744456.466637:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 12 pid: 14312 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466651:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 12 pid: 14312 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466676:0:14297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77600/0x7cd2bfd5e1b95b5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761644 expref: 12 pid: 14312 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466696:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:0.0:1788744456.466700:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466710:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466732:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.466759:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788744456.466818:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c7cc926b-941e-4823-a2f7-075948338613+11:2354:x1875634047538048:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 212us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744456.466826:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00010000:00010000:1.0:1788744456.467155:0:14312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.467164:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.467187:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.467196:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.467204:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468191:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468203:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468212:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744456.468229:0:14312:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744456.468255:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468262:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468269:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468274:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744456.468279:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468295:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468305:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:1.0:1788744456.468308:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744456.468312:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468318:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76c00/0x7cd2bfd5e1b95b85 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788744456.468329:0:14312:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a428f827 reply state 000000005eaea146 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744456.468337:0:14312:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788744456.468369:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95b7e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 14 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468392:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 13 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.468399:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744456.468402:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788744456.468404:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2000, rc 0) 00000100:00100000:1.0:1788744456.468879:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14419:x1875634047537920:12345-192.168.204.56@tcp:101:bash.0 Request processed in 9940us (10733us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788744456.468889:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 28 00010000:00010000:0.0:1788744456.472033:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472066:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472075:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472081:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2200 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744456.472085:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472093:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472111:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff940ac3570300) 00010000:00010000:0.0:1788744456.472114:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744456.472119:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744456.472125:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95b8c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744456.494640:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.494753:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047538176 00000100:00100000:2.0:1788744456.494764:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047538176 00000100:00100000:2.0:1788744456.494828:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:2.0:1788744456.494839:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+13:14419:x1875634047538176:12345-192.168.204.56@tcp:101:bash.0 00010000:00010000:2.0:1788744456.494864:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.494885:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95ba1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761659 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.494975:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.494990:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.495003:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.495047:0:15478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788744456.495057:0:15478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744456.495078:0:15478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.495088:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.495112:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95ba1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 15 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.495130:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 14 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.495138:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744456.495141:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744456.495144:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df600, rc 0) 00000100:00100000:2.0:1788744456.495209:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14419:x1875634047538176:12345-192.168.204.56@tcp:101:bash.0 Request processed in 371us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.495217:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 29 00000100:00100000:1.0:1788744456.507958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.508101:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047538432 00000100:00100000:2.0:1788744456.508114:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047538432 00000100:00100000:2.0:1788744456.508168:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:2.0:1788744456.508179:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14419:x1875634047538432:12345-192.168.204.56@tcp:35:bash.0 00000100:00100000:2.0:1788744456.508648:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+15:14419:x1875634047538432:12345-192.168.204.56@tcp:35:bash.0 Request processed in 469us (702us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788744456.508656:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000040:00080000:3.0:1788744456.540274:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788744456.639079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.639398:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047538688 00000100:00100000:2.0:1788744456.639415:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047538688 00000100:00100000:2.0:1788744456.639513:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:2.0:1788744456.639533:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+15:14429:x1875634047538688:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744456.639603:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.639630:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761660 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.639751:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788744456.639914:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95baf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761660 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.639931:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff940ad0017300) 00010000:00010000:2.0:1788744456.639935:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744456.639941:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761660 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.639959:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dfa00, rc 0) 00000100:00100000:2.0:1788744456.640060:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:14429:x1875634047538688:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 529us (996us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788744456.640068:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:1.0:1788744456.650259:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.650597:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047538944 00000100:00100000:2.0:1788744456.650610:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047538944 00000100:00100000:2.0:1788744456.650680:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:2.0:1788744456.650693:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:14429:x1875634047538944:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744456.651023:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14429:x1875634047538944:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 331us (774us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788744456.651032:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:0.0:1788744456.714929:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.715013:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047539200 00000100:00100000:2.0:1788744456.715041:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047539200 00000100:00100000:2.0:1788744456.715104:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:2.0:1788744456.715117:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14432:x1875634047539200:12345-192.168.204.56@tcp:101:lfs.0 00010000:00010000:2.0:1788744456.715144:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744456.715170:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bbd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761667 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.715310:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95bc4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.715325:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.715340:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744456.715353:0:15478:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788744456.715524:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bbd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761667 expref: 20 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.715546:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761667 expref: 19 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.715611:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744456.715614:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788744456.715618:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24de000, rc 0) 00000100:00100000:2.0:1788744456.716248:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+19:14432:x1875634047539200:12345-192.168.204.56@tcp:101:lfs.0 Request processed in 1130us (1331us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788744456.716259:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:3.0:1788744456.724898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744456.725016:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.725127:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047539456 00000100:00100000:1.0:1788744456.725144:0:14296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047539456 00000100:00100000:1.0:1788744456.725234:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:1.0:1788744456.725246:0:14296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+19:2352:x1875634047539456:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788744456.725265:0:14296:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744456.725310:0:14296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24de000/0x7cd2bfd5e1b95bc4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761667 expref: 19 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.725340:0:14296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744456.725346:0:14296:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788744456.725427:0:14296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:2352:x1875634047539456:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 182us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744456.725442:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:2.0:1788744456.726269:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047539328 00000100:00100000:2.0:1788744456.726289:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047539328 00000100:00100000:2.0:1788744456.726330:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:2.0:1788744456.726338:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14432:x1875634047539328:12345-192.168.204.56@tcp:54:lfs.0 00010000:00010000:2.0:1788744456.726409:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726429:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726443:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726478:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726486:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726493:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726499:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dfa00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744456.726503:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726511:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726520:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744456.726524:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788744456.726540:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.726562:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bd2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744456.726629:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14432:x1875634047539328:12345-192.168.204.56@tcp:54:lfs.0 Request processed in 291us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.726636:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 32 00000100:00100000:3.0:1788744456.730385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.731703:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068499328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788744456.731796:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744456.733830:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047539712 00000100:00100000:2.0:1788744456.733853:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047539712 00000100:00100000:2.0:1788744456.733928:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:2.0:1788744456.733939:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14432:x1875634047539712:12345-192.168.204.56@tcp:35:lfs.0 00000100:00100000:2.0:1788744456.734387:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+19:14432:x1875634047539712:12345-192.168.204.56@tcp:35:lfs.0 Request processed in 448us (4015us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788744456.734395:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:1.0:1788744456.735244:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068499328 00000100:00100000:1.0:1788744456.735258:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068499328 00000100:00100000:1.0:1788744456.735324:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788744456.735333:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068499328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788744456.735920:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788744456.736053:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068499328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 720us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744456.736063:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788744456.736261:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068499328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788744456.736372:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788744456.963729:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744456.963817:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047539968 00000100:00100000:1.0:1788744456.963829:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047539968 00000100:00100000:1.0:1788744456.963901:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:1.0:1788744456.963913:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+19:14463:x1875634047539968:12345-192.168.204.56@tcp:101:cat.0 00010000:00010000:1.0:1788744456.963938:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744456.963961:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95bd9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576166e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.964083:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95be0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.964113:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.964127:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95be0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744456.964141:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744456.964328:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95bd9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576166e expref: 22 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.964372:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95be0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576166e expref: 21 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744456.964381:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744456.964385:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788744456.964388:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d3600, rc 0) 00000100:00100000:1.0:1788744456.964467:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:14463:x1875634047539968:12345-192.168.204.56@tcp:101:cat.0 Request processed in 555us (764us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788744456.964476:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 33 00000100:00100000:3.0:1788744456.968594:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744456.968661:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047540224 00000100:00100000:0.0:1788744456.968673:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047540224 00000100:00100000:0.0:1788744456.968744:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:0.0:1788744456.968757:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:14463:x1875634047540224:12345-192.168.204.56@tcp:35:cat.0 00000100:00100000:0.0:1788744456.969221:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+22:14463:x1875634047540224:12345-192.168.204.56@tcp:35:cat.0 Request processed in 465us (681us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788744456.969229:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 8 00000100:00100000:3.0:1788744456.970819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744456.971415:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047540352 00000100:00100000:2.0:1788744456.971426:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047540352 00000100:00100000:2.0:1788744456.971502:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744456.971513:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+22:2351:x1875634047540352:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744456.971534:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744456.971593:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95be0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576166e expref: 22 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744456.971618:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744456.971625:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744456.971720:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:2351:x1875634047540352:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 207us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744456.971729:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:3.0:1788744457.052854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.053019:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047540608 00000100:00100000:2.0:1788744457.053030:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047540608 00000100:00100000:2.0:1788744457.053182:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:2.0:1788744457.053195:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:14469:x1875634047540608:12345-192.168.204.56@tcp:101:dd.0 00010000:00010000:2.0:1788744457.053227:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744457.053252:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761675 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053392:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053410:0:14313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053420:0:14313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 22 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053441:0:14313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053485:0:14313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 22 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053501:0:14313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 22 pid: 15478 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.053537:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14313:1875634068499456:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744457.053690:0:14313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.053701:0:14313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.053710:0:14313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14313:1875634068499584:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744457.053738:0:14313:0:(client.c:2716:ptlrpc_set_wait()) set ffff940afaa1ca80 going to sleep for 11 seconds 00000100:00080000:0.0:1788744457.055188:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744457.056799:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14313:1875634068499456:192.168.204.56@tcp:104: 00000100:00100000:2.0:1788744457.056817:0:14313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af73ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14313:1875634068499584:192.168.204.56@tcp:104: 00010000:00010000:2.0:1788744457.056861:0:14313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744457.057190:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.057231:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.057411:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047540736 00000100:00100000:2.0:1788744457.057430:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047540736 00010000:00010000:2.0:1788744457.057474:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 23 pid: 15478 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.057512:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047540864 00000100:00100000:2.0:1788744457.057515:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047540864 00010000:00010000:2.0:1788744457.057525:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 24 pid: 14312 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.057537:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:2.0:1788744457.057579:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afb61f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+24:2354:x1875634047540736:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744457.057596:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744457.057603:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 24 pid: 15478 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057615:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 24 pid: 15478 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057636:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95ba8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761659 expref: 24 pid: 15478 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057652:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.057656:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057665:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057672:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744457.057721:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afb61f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:2354:x1875634047540736:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 143us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.057727:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:2.0:1788744457.057781:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 12 00000100:00100000:2.0:1788744457.057787:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+22:2354:x1875634047540864:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744457.057794:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744457.057799:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057820:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057832:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95b93 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761652 expref: 22 pid: 14312 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057843:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.057847:0:14298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057854:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057862:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057886:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744457.057904:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:2354:x1875634047540864:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 118us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.057910:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 12 00010000:00010000:2.0:1788744457.057928:0:14313:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.057934:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744457.057955:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788744457.058110:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95bee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761675 expref: 22 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.058133:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfc00/0x7cd2bfd5e1b95bf5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761675 expref: 21 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.058140:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.058143:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788744457.058145:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24dfc00, rc 0) 00000100:00100000:2.0:1788744457.058166:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:14469:x1875634047540608:12345-192.168.204.56@tcp:101:dd.0 Request processed in 4976us (5324us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788744457.058173:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 34 00000100:00100000:3.0:1788744457.062836:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.063022:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541120 00000100:00100000:1.0:1788744457.063035:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541120 00000100:00100000:1.0:1788744457.063140:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 35 00000100:00100000:1.0:1788744457.063153:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+21:14469:x1875634047541120:12345-192.168.204.56@tcp:36:dd.0 00010000:00010000:1.0:1788744457.063447:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.063464:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.063475:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744457.063596:0:14311:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788744457.063644:0:14311:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005de19b93 reply state 00000000b092aedb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.063653:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788744457.063772:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+24:14469:x1875634047541120:12345-192.168.204.56@tcp:36:dd.0 Request processed in 622us (947us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788744457.063780:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 35 00000020:00080000:1.0:1788744457.063786:0:14311:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788744457.065764:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065784:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065793:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065799:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744457.065804:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065812:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065828:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:0.0:1788744457.065831:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744457.065836:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.065843:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95c03 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744457.067162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.070359:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541248 00000100:00100000:2.0:1788744457.070390:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541248 00000100:00100000:2.0:1788744457.070491:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:2.0:1788744457.070505:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:14469:x1875634047541248:12345-192.168.204.56@tcp:101:dd.0 00010000:00010000:2.0:1788744457.070536:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788744457.070589:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c0a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576167c expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.070662:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576167c expref: 24 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.070682:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c0a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576167c expref: 24 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.070791:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.070794:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788744457.070815:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9409c24df000, rc 0) 00000100:00100000:2.0:1788744457.070960:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+24:14469:x1875634047541248:12345-192.168.204.56@tcp:101:dd.0 Request processed in 457us (3805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.070967:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 36 00000100:00100000:3.0:1788744457.083150:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.083838:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541504 00000100:00100000:2.0:1788744457.083853:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541504 00000100:00100000:2.0:1788744457.083998:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:2.0:1788744457.084010:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+24:14469:x1875634047541504:12345-192.168.204.56@tcp:103:dd.0 00010000:00010000:2.0:1788744457.084027:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744457.084052:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c0a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576167c expref: 24 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.084071:0:14298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.084077:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744457.084142:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:14469:x1875634047541504:12345-192.168.204.56@tcp:103:dd.0 Request processed in 135us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.084150:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:3.0:1788744457.086147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.086506:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541632 00000100:00100000:2.0:1788744457.086519:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541632 00000100:00100000:2.0:1788744457.086647:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:2.0:1788744457.086661:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:14469:x1875634047541632:12345-192.168.204.56@tcp:58:dd.0 00010000:00010000:2.0:1788744457.086983:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.087009:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.087030:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788744457.088248:0:14313:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788744457.088998:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788744457.089086:0:14313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788744457.089322:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:14469:x1875634047541632:12345-192.168.204.56@tcp:58:dd.0 Request processed in 2657us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.089336:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 37 00000100:00100000:3.0:1788744457.092981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.093187:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541760 00000100:00100000:1.0:1788744457.093199:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541760 00000100:00100000:1.0:1788744457.093267:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 38 00000100:00100000:1.0:1788744457.093288:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+23:14469:x1875634047541760:12345-192.168.204.56@tcp:101:dd.0 00010000:00010000:1.0:1788744457.093311:0:14312:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744457.093336:0:14312:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761683 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093412:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093436:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 24 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093460:0:14312:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093475:0:14312:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 24 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093489:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744457.093493:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744457.093497:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 24 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.093523:0:14312:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2200, rc 0) 00000100:00100000:1.0:1788744457.093619:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+24:14469:x1875634047541760:12345-192.168.204.56@tcp:101:dd.0 Request processed in 332us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.093626:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 38 00010000:00010000:2.0:1788744457.248155:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788744457.292850:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:2.0:1788744457.292868:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1788744457.292954:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000040:00080000:3.0:1788744457.562871:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744457.562882:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744457.562920:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788744457.562927:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788744457.563080:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14345:1875634068499712:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744457.563219:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2f24600 going to sleep for 11 seconds 00000100:00100000:3.0:1788744457.579613:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14345:1875634068499712:192.168.204.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788744457.590335:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.590463:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047541888 00000100:00100000:0.0:1788744457.590474:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047541888 00000100:00100000:0.0:1788744457.590533:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:0.0:1788744457.590589:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047541888:12345-192.168.204.56@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788744457.590705:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047541888:12345-192.168.204.56@tcp:900:lhsmtool_posix.0 Request processed in 108us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.590716:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:0.0:1788744457.602075:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.606573:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047542016 00000100:00100000:1.0:1788744457.606591:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047542016 00000100:00100000:1.0:1788744457.606934:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:1.0:1788744457.606948:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047542016:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788744457.607138:0:14311:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788744457.607281:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047542016:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 335us (5214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.607290:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 39 00000100:00100000:3.0:1788744457.610776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.630148:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047542144 00000100:00100000:2.0:1788744457.630167:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047542144 00000100:00100000:2.0:1788744457.630287:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:2.0:1788744457.630302:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047542144:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788744457.630404:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630423:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630437:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630505:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630513:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630568:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630593:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630614:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630620:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788744457.630661:0:14313:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788744457.630665:0:14313:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788744457.630677:0:14313:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630688:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630906:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630914:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630920:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744457.630924:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630931:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630951:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ad0012200) 00010000:00010000:2.0:1788744457.630954:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744457.630970:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630978:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df000/0x7cd2bfd5e1b95c1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.630994:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631001:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631007:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631012:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744457.631015:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631021:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631028:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff940ad0017e00) 00010000:00010000:2.0:1788744457.631030:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744457.631033:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631039:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24df600/0x7cd2bfd5e1b95c26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631067:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631073:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631079:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631085:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dea00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:2.0:1788744457.631088:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631094:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631102:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:2.0:1788744457.631105:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788744457.631107:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.631113:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dea00/0x7cd2bfd5e1b95c2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.631209:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047542144:12345-192.168.204.56@tcp:34:lhsmtool_posix.0 Request processed in 909us (20448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.631218:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 40 00000100:00100000:3.0:1788744457.636172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.636276:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047542400 00000100:00100000:1.0:1788744457.636287:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047542400 00000100:00100000:1.0:1788744457.636351:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:1.0:1788744457.636362:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:14470:x1875634047542400:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788744457.636394:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788744457.636416:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576168a expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.636517:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.636542:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.636592:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788744457.636810:0:14311:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788744457.636950:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.636958:0:14311:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637083:0:14311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637089:0:14311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.637095:0:14311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637102:0:14311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637114:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744457.637117:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788744457.637122:0:14311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637128:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c3b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637176:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c34 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576168a expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637198:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff940ad0012200) 00010000:00010000:1.0:1788744457.637200:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788744457.637204:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576168a expref: 13 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.637213:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940af73d2400, rc 0) 00000100:00100000:1.0:1788744457.637322:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+12:14470:x1875634047542400:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 962us (1637us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788744457.637331:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 41 00000100:00100000:2.0:1788744457.648758:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.648893:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047542528 00000100:00100000:0.0:1788744457.648905:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047542528 00000100:00100000:0.0:1788744457.648991:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:0.0:1788744457.649005:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+12:14470:x1875634047542528:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788744457.649053:0:15478:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788744457.649181:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+12:14470:x1875634047542528:12345-192.168.204.56@tcp:53:lhsmtool_posix.0 Request processed in 178us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.649189:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 42 00000100:00100000:2.0:1788744457.659096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.659211:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047542784 00000100:00100000:3.0:1788744457.659224:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047542784 00000100:00100000:3.0:1788744457.659311:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:3.0:1788744457.659323:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+12:14470:x1875634047542784:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744457.659377:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744457.659407:0:14313:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95c49 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761691 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788744457.661035:0:14313:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1788744457.661045:0:14313:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788744457.661093:0:14313:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788744457.663821:0:14313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.663849:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.663864:0:14313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.663941:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb400/0x7cd2bfd5e1b95c49 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761691 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.663964:0:14313:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761691 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.663993:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:0.0:1788744457.663996:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788744457.663999:0:14313:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76e00, rc 0) 00000100:00100000:0.0:1788744457.664226:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047542784:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 4902us (5140us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788744457.664238:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 43 00000100:00100000:3.0:1788744457.674514:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.674700:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543040 00000100:00100000:1.0:1788744457.674776:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543040 00000100:00100000:1.0:1788744457.674882:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:1.0:1788744457.674893:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047543040:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788744457.674960:0:14312:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788744457.674993:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761691 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675015:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad90afe00) 00010000:00010000:1.0:1788744457.675027:0:14312:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788744457.675062:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675075:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675086:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675116:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675124:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675130:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675852:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675864:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675871:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675878:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2400 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.675883:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675890:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675900:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff940ad90af500) 00010000:00010000:1.0:1788744457.675903:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744457.675907:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675913:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2400/0x7cd2bfd5e1b95c5e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675931:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675937:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675943:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675947:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2800 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.675950:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675955:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675962:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4fb8f54d (ffff940ac3570400) 00010000:00010000:1.0:1788744457.675964:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744457.675967:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.675972:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2800/0x7cd2bfd5e1b95c65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4fb8f54d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.676086:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+13:14470:x1875634047543040:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 1192us (1583us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788744457.676093:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 44 00000100:00100000:2.0:1788744457.679845:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.681236:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543168 00000100:00100000:0.0:1788744457.681269:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543168 00000100:00100000:3.0:1788744457.681574:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:3.0:1788744457.681590:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+13:14470:x1875634047543168:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744457.681618:0:14311:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744457.681645:0:14311:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95c6c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb5761698 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681691:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95c73 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681705:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681716:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95c73 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681821:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca600/0x7cd2bfd5e1b95c6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761698 expref: 15 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681840:0:14311:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29ca800/0x7cd2bfd5e1b95c73 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761698 expref: 14 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.681863:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:3.0:1788744457.681866:0:14311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788744457.681870:0:14311:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29ca800, rc 0) 00000100:00100000:3.0:1788744457.681944:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047543168:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 359us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744457.681951:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 45 00000100:00100000:2.0:1788744457.689812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.690040:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543424 00000100:00100000:3.0:1788744457.690053:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543424 00000100:00100000:3.0:1788744457.690178:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 46 00000100:00100000:3.0:1788744457.690192:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047543424:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744457.690316:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.690336:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.690350:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788744457.691967:0:14311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788744457.691984:0:14311:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529824433256ns, next at 530824429735ns, rc = 0 00000004:00010000:3.0:1788744457.692093:0:14311:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000032129b66 reply state 00000000f627371c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744457.692106:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744457.692245:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:14470:x1875634047543424:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 2053us (2444us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788744457.692277:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 46 00010000:00010000:0.0:1788744457.701226:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701249:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701258:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701275:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cb000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744457.701280:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701288:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701306:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:0.0:1788744457.701309:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788744457.701315:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.701343:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cb000/0x7cd2bfd5e1b95c7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.704123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.704208:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543552 00000100:00100000:0.0:1788744457.704219:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543552 00000100:00100000:0.0:1788744457.704287:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:0.0:1788744457.704304:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+15:14470:x1875634047543552:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744457.704326:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744457.704347:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb576169f expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.704427:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 16 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.704442:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 16 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.704462:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:0.0:1788744457.704464:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788744457.704468:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76e00, rc 0) 00000100:00100000:0.0:1788744457.704580:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:14470:x1875634047543552:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 254us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.704587:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 47 00000100:00100000:0.0:1788744457.710701:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.710812:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543680 00000100:00100000:1.0:1788744457.710828:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543680 00000100:00100000:1.0:1788744457.710915:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:1.0:1788744457.710943:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047543680:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788744457.711700:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744457.712238:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2354:x1875634047543680:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 1294us (1544us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788744457.712248:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:1.0:1788744457.716074:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.716172:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047543936 00000100:00100000:0.0:1788744457.716184:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047543936 00000100:00100000:0.0:1788744457.716272:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:0.0:1788744457.716285:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:14470:x1875634047543936:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788744457.716596:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14470:x1875634047543936:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 312us (535us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788744457.716604:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 9 00000100:00100000:2.0:1788744457.719348:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.722087:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544192 00000100:00100000:1.0:1788744457.722105:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544192 00000100:00100000:1.0:1788744457.722195:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:1.0:1788744457.722206:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14470:x1875634047544192:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788744457.722355:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940b00b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14470:x1875634047544192:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (3018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.722364:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 48 00000100:00100000:1.0:1788744457.732671:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.732851:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544320 00000100:00100000:0.0:1788744457.732865:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544320 00000100:00100000:0.0:1788744457.732938:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:0.0:1788744457.732949:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+17:14470:x1875634047544320:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788744457.732986:0:15478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788744457.733010:0:15478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95c88 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57616a6 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733093:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733109:0:15478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733123:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788744457.733165:0:15478:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788744457.733187:0:15478:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15478 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733216:0:15478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76600/0x7cd2bfd5e1b95c88 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616a6 expref: 19 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733274:0:15478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616a6 expref: 18 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.733285:0:15478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:0.0:1788744457.733288:0:15478:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788744457.733293:0:15478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940afaa76000, rc 0) 00000100:00100000:0.0:1788744457.733380:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047544320:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 432us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.733389:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 49 00000100:00100000:2.0:1788744457.737381:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.740545:0:14999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544448 00000100:00100000:3.0:1788744457.740611:0:14999:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544448 00000100:00100000:3.0:1788744457.740697:0:14999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:3.0:1788744457.740709:0:14999:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2353:x1875634047544448:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788744457.740730:0:14999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788744457.740756:0:14999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4df862bdb57616ad expref: -99 pid: 14999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744457.740788:0:14999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e1309, blocks: 0x1 00010000:00010000:3.0:1788744457.740812:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1788744457.740818:0:14999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744457.740827:0:14999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 7 pid: 14999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.740850:0:14999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 7 pid: 14999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.740864:0:14999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff940ac29ca600, rc 0) 00000100:00100000:3.0:1788744457.740943:0:14999:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2353:x1875634047544448:12345-192.168.204.56@tcp:101:lhsmtool_posix.0 Request processed in 235us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744457.740963:0:14999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:1.0:1788744457.749938:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.750211:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544704 00000100:00100000:0.0:1788744457.750222:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544704 00000100:00100000:0.0:1788744457.750296:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:0.0:1788744457.750307:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047544704:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788744457.750433:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047544704:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 127us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.750441:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 50 00000100:00100000:1.0:1788744457.755047:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.757206:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544832 00000100:00100000:2.0:1788744457.757223:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544832 00000100:00100000:2.0:1788744457.757297:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 51 00000100:00100000:2.0:1788744457.757309:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047544832:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788744457.757537:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068499968:0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.757641:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744457.757718:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068500480:0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.757748:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744457.757773:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788744457.757779:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068500096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.757803:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744457.757862:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068499968 00000100:00100000:1.0:1788744457.757867:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068499968 00000100:00100000:1.0:1788744457.757895:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500096 00000100:00100000:1.0:1788744457.757914:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500096 00000100:00100000:1.0:1788744457.757954:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744457.757961:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068499968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.758011:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068499968:12345-0@lo:400:kworker.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.758019:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788744457.758037:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788744457.758044:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068500096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.758072:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068500096:12345-0@lo:400:kworker.0 Request processed in 28us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.758078:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788744457.758097:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788744457.758131:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068500096:0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.758144:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068499968:0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.758170:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500480 00000100:00100000:1.0:1788744457.758174:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500480 00000100:00080000:1.0:1788744457.758189:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788744457.758212:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744457.758218:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068500480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.758254:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875634068500480:12345-0@lo:400:kworker.0 Request processed in 36us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.758272:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788744457.758297:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875634068500480:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.759456:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068499840:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.759528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744457.759615:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068500352:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.759643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744457.759668:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788744457.759674:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068500224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.759696:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744457.761915:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788744457.761937:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068500608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744457.762019:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744457.762083:0:15001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500608 00000100:00100000:3.0:1788744457.762091:0:15001:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500608 00000100:00100000:3.0:1788744457.762144:0:15001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744457.762154:0:15001:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068500608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788744457.762196:0:15001:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788744457.762243:0:15001:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875634068500608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744457.762249:0:15001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788744457.762310:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875634068500608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788744457.762335:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500352 00000100:00100000:3.0:1788744457.762339:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500352 00000100:00100000:3.0:1788744457.762370:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500224 00000100:00100000:3.0:1788744457.762373:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500224 00000100:00100000:3.0:1788744457.762387:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744457.762393:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068500352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744457.762433:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af73a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875634068500352:12345-0@lo:400:kworker.0 Request processed in 40us (2789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744457.762439:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788744457.762451:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788744457.762457:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068500224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788744457.762484:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875634068500224:12345-0@lo:400:kworker.0 Request processed in 27us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744457.762491:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788744457.763157:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068499840 00000100:00100000:1.0:1788744457.763166:0:14306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068499840 00000100:00100000:1.0:1788744457.763203:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788744457.763218:0:14306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3311:x1875634068499840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788744457.763280:0:14306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:273d7090-42fe-4f7f-bcb4-bccbf35a43d0+19:3311:x1875634068499840:12345-0@lo:400:kworker.0 Request processed in 64us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788744457.763287:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788744457.765512:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744457.768168:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875634068500224:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.768186:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:273d7090-42fe-4f7f-bcb4-bccbf35a43d0:3311:1875634068499840:0@lo:400:kworker.0 00000100:00100000:2.0:1788744457.768198:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875634068500352:0@lo:400:kworker.0 00000001:00080000:1.0:1788744457.805908:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788744457.830274:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047544832:12345-192.168.204.56@tcp:44:lhsmtool_posix.0 Request processed in 72942us (75212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.830291:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 51 00000001:00080000:0.0:1788744457.830336:0:5858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788744457.830357:0:5858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788744457.832813:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068500736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788744457.832904:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788744457.832966:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500736 00000100:00100000:3.0:1788744457.832991:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500736 00000100:00100000:3.0:1788744457.833042:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788744457.833053:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875634068500736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788744457.833283:0:14996:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788744457.833288:0:14996:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788744457.833290:0:14996:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788744457.833292:0:14996:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788744457 -> 1788744457 00002000:00010000:3.0:1788744457.833295:0:14996:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788744457.833339:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875634068500736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (435us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788744457.833348:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788744457.833857:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff940aff97dc00/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788744457.833865:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875634068500736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788744457.839515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.839771:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047544960 00000100:00100000:2.0:1788744457.839783:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047544960 00000100:00100000:2.0:1788744457.839844:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:2.0:1788744457.839856:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2352:x1875634047544960:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788744457.839985:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2352:x1875634047544960:12345-192.168.204.56@tcp:16:lhsmtool_posix.0 Request processed in 130us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.840008:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 16 00000100:00100000:0.0:1788744457.843399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.843515:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545216 00000100:00100000:3.0:1788744457.843527:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545216 00000100:00100000:3.0:1788744457.843618:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 52 00000100:00100000:3.0:1788744457.843630:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047545216:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788744457.843693:0:14311:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788744457.843736:0:14311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76000/0x7cd2bfd5e1b95c8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616a6 expref: 14 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.843759:0:14311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:3.0:1788744457.843765:0:14311:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788744457.843798:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.843811:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.843838:0:14311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788744457.844070:0:14311:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a6a0ab96 reply state 00000000573a9a36 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744457.844081:0:14311:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788744457.844211:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+15:14470:x1875634047545216:12345-192.168.204.56@tcp:36:lhsmtool_posix.0 Request processed in 583us (822us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788744457.844220:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 52 00010000:00010000:0.0:1788744457.852333:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852382:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852390:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852397:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29cba00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:0.0:1788744457.852402:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852419:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852437:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:0.0:1788744457.852440:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788744457.852445:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.852451:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940ac29cba00/0x7cd2bfd5e1b95c9d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14311 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744457.853637:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744457.853703:0:14996:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545344 00000100:00100000:3.0:1788744457.853716:0:14996:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545344 00000100:00100000:3.0:1788744457.853821:0:14996:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:3.0:1788744457.853833:0:14996:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2353:x1875634047545344:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788744457.854077:0:14996:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788744457.854081:0:14996:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788744456 00002000:00010000:3.0:1788744457.854084:0:14996:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788744456 00002000:00010000:3.0:1788744457.854087:0:14996:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788744457 -> 1788744456 00002000:00010000:3.0:1788744457.854089:0:14996:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788744457.854165:0:14996:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2353:x1875634047545344:12345-192.168.204.56@tcp:2:lhsmtool_posix.0 Request processed in 333us (535us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788744457.854174:0:14996:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:1.0:1788744457.858170:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.859400:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545472 00000100:00100000:2.0:1788744457.859417:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545472 00000100:00100000:2.0:1788744457.859498:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744457.859511:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2352:x1875634047545472:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788744457.859610:0:14998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859631:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744457.859637:0:14998:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744457.859643:0:14998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859660:0:14998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859694:0:14998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859703:0:14998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859712:0:14998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859720:0:14998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dea00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744457.859741:0:14998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859752:0:14998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859771:0:14998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.859780:0:14998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db2c1a43/0x7cd2bfd5e1b95ca4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.859884:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2352:x1875634047545472:12345-192.168.204.56@tcp:1:lhsmtool_posix.0 Request processed in 375us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.859892:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744457.869707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744457.869819:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545728 00000100:00100000:1.0:1788744457.869832:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545728 00000100:00100000:1.0:1788744457.869907:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 53 00000100:00100000:1.0:1788744457.869917:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:14470:x1875634047545728:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788744457.870033:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870056:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870076:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870430:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870444:0:14312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 15 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870453:0:14312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870504:0:14312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 15 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.870520:0:14312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 15 pid: 15478 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.870534:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068500864:192.168.204.56@tcp:104: 00000100:00100000:1.0:1788744457.870847:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788744457.883699:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744457.883809:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545856 00000100:00100000:2.0:1788744457.883820:0:14297:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545856 00010000:00010000:2.0:1788744457.883870:0:14297:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 16 pid: 15478 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744457.883917:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 13 00000100:00100000:2.0:1788744457.883928:0:14297:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:2354:x1875634047545856:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744457.883944:0:14297:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744457.883951:0:14297:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 16 pid: 15478 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.883984:0:14297:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 16 pid: 15478 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.884014:0:14297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:2.0:1788744457.884021:0:14297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.884031:0:14297:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.884039:0:14297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744457.884060:0:14297:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744457.884128:0:14297:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+16:2354:x1875634047545856:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 201us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744457.884136:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 13 00010000:00010000:1.0:1788744457.884506:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa76e00/0x7cd2bfd5e1b95c81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb576169f expref: 15 pid: 15478 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.884527:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068500864:192.168.204.56@tcp:104: 00010000:00010000:1.0:1788744457.884602:0:14312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.884613:0:14312:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.884619:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744457.884849:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788744457.885010:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788744457.885059:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788744457.885152:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14312:1875634068500992:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788744457.885435:0:14312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788744457.885471:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788744457.885509:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068500992 00000100:00100000:0.0:1788744457.885516:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068500992 00000100:00100000:0.0:1788744457.885582:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788744457.885592:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14312:x1875634068500992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788744457.885698:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14312:x1875634068500992:12345-0@lo:1000:mdt00_001.0 Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.885714:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788744457.885813:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14312:1875634068500992:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788744457.887761:0:14312:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788744457.887866:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14312:1875634068501120:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788744457.887935:0:14312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788744457.887982:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ae0760600 going to sleep for 11 seconds 00000100:00100000:0.0:1788744457.888317:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634068501120 00000100:00100000:0.0:1788744457.888326:0:14316:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634068501120 00000100:00100000:0.0:1788744457.888380:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788744457.888392:0:14316:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14312:x1875634068501120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788744457.890666:0:14316:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14312:x1875634068501120:12345-0@lo:1000:mdt00_001.0 Request processed in 2266us (2720us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788744457.890681:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788744457.890930:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940ace16dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14312:1875634068501120:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788744457.890984:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.890995:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891004:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891011:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2000 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.891016:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891023:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891040:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:1.0:1788744457.891043:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744457.891048:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891055:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2000/0x7cd2bfd5e1b95cb2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891097:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891104:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891110:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891133:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24dfa00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.891137:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891144:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891153:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744457.891156:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788744457.891164:0:14312:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891176:0:14312:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891186:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.891353:0:14312:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2200/0x7cd2bfd5e1b95c18 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb5761683 expref: 18 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.891374:0:14312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068501248:192.168.204.56@tcp:105: 00000100:00100000:1.0:1788744457.891570:0:14312:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad2fe5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788744457.899375:0:14312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940af6e2d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14312:1875634068501248:192.168.204.56@tcp:105: 00010000:00010000:1.0:1788744457.899415:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899447:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9409c24dfa00/0x7cd2bfd5e1b95c11 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14313 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899482:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899495:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899506:0:14312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899517:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899523:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899529:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899535:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d3600 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.899538:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899545:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899593:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744457.899596:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788744457.899600:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899613:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d3600/0x7cd2bfd5e1b95cb9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899626:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899632:0:14312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899638:0:14312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899643:0:14312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940af73d2c00 already unused, calling callback (ffffffffc1ef54f0) 00010000:00010000:1.0:1788744457.899646:0:14312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899651:0:14312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899659:0:14312:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff940ac3570e00) 00010000:00010000:1.0:1788744457.899662:0:14312:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788744457.899665:0:14312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788744457.899670:0:14312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940af73d2c00/0x7cd2bfd5e1b95cab lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14312 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788744457.899992:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047545728:12345-192.168.204.56@tcp:57:lhsmtool_posix.0 Request processed in 30074us (30298us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788744457.900006:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 53 00000020:00080000:1.0:1788744457.900020:0:14312:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788744457.900250:0:14345:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788744457.900264:0:14345:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788744457.900297:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788744457.900304:0:14345:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788744457.901684:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.901791:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047545984 00000100:00100000:0.0:1788744457.901805:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047545984 00000100:00100000:0.0:1788744457.901888:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:0.0:1788744457.901902:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace6a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14469:x1875634047545984:12345-192.168.204.56@tcp:49:dd.0 00000100:00100000:0.0:1788744457.902072:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace6a4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14469:x1875634047545984:12345-192.168.204.56@tcp:49:dd.0 Request processed in 173us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788744457.902081:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 10 00000100:00100000:2.0:1788744457.916716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744457.916840:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546240 00000100:00100000:0.0:1788744457.916856:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546240 00000100:00100000:0.0:1788744457.916936:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 11 00000100:00100000:0.0:1788744457.916951:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+18:14470:x1875634047546240:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788744457.918988:0:14314:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788744457.919118:0:14314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788744457.919166:0:14314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919185:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919211:0:14314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919221:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919228:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919234:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744457.919276:0:14314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788744457.919400:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+20:14470:x1875634047546240:12345-192.168.204.56@tcp:35:lhsmtool_posix.0 Request processed in 2448us (2700us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788744457.919410:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 11 00000020:00080000:0.0:1788744457.919417:0:14314:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788744457.919518:0:14299:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788744457.919531:0:14299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.919539:0:14299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744457.919543:0:14299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.919581:0:14299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.919597:0:14299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff940ad0012000) 00010000:00010000:3.0:1788744457.919599:0:14299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788744457.919605:0:14299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.919611:0:14299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff940afaa77400/0x7cd2bfd5e1b95cc0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744457.919625:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744457.919627:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788744457.919629:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788744458.151176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744458.151221:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:1.0:1788744458.151280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744458.151385:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546496 00000100:00100000:2.0:1788744458.151399:0:15002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546496 00000100:00100000:0.0:1788744458.151435:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546368 00000100:00100000:0.0:1788744458.151441:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546368 00000100:00100000:2.0:1788744458.151487:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546624 00000100:00100000:0.0:1788744458.151493:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:0.0:1788744458.151507:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+8:2353:x1875634047546496:12345-192.168.204.56@tcp:4:dd.0 00000100:00100000:2.0:1788744458.151509:0:15002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546624 00010000:00010000:0.0:1788744458.151586:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.151609:0:15004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 9 pid: 14999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.151620:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788744458.151631:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744458.151636:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.151689:0:15004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 9 pid: 14999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.151710:0:15004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 9 pid: 14999 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744458.151729:0:15004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff940aff8ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:15004:1875634068501376:192.168.204.56@tcp:104: 00000100:00100000:0.0:1788744458.151873:0:15004:0:(client.c:2716:ptlrpc_set_wait()) set ffff940ad8188a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788744458.159070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744458.159595:0:15004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff940aff8ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:15004:1875634068501376:192.168.204.56@tcp:104: 00010000:00010000:0.0:1788744458.159628:0:15004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744458.160046:0:14298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546752 00000100:00100000:2.0:1788744458.160055:0:14298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546752 00010000:00010000:2.0:1788744458.160100:0:14298:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 10 pid: 14999 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744458.160155:0:14298:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 14 00000100:00100000:2.0:1788744458.160166:0:14298:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+10:2353:x1875634047546752:12345-192.168.204.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788744458.160183:0:14298:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788744458.160208:0:14298:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 10 pid: 14999 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.160221:0:14298:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 10 pid: 14999 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.160249:0:14298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95c96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.56@tcp remote: 0x4df862bdb57616ad expref: 10 pid: 14999 timeout: 630 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.160276:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744458.160280:0:14298:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744458.160286:0:14298:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.160296:0:14298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.160328:0:14298:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788744458.160405:0:14298:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:2353:x1875634047546752:12345-192.168.204.56@tcp:103:ldlm_bl.0 Request processed in 240us (1346us total) trans 0 rc 0/0 00010000:00010000:3.0:1788744458.160930:0:15004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.160941:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744458.160985:0:14298:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 14 00010000:00010000:2.0:1788744458.270274:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788744458.312096:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1788744458.312122:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788744458.312204:0:15004:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788744458.312209:0:15004:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788744456 -> 1788744457 00002000:00010000:2.0:1788744458.312212:0:15004:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788744458.312229:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312243:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312263:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312271:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76c00 already unused, calling callback (ffffffffc1485940) 00010000:00010000:2.0:1788744458.312276:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312285:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312305:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312312:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bddd45fd/0x7cd2bfd5e1b95cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788744458.312716:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2353:x1875634047546496:12345-192.168.204.56@tcp:4:dd.0 Request processed in 161204us (161557us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788744458.312727:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 0 00000100:00100000:2.0:1788744458.312762:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:2.0:1788744458.312774:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2354:x1875634047546368:12345-192.168.204.56@tcp:4:dd.0 00002000:00010000:2.0:1788744458.312815:0:15004:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9e1309, atime: 0x6a9e1308, ctime: 0x0, blocks: 0x807 00010000:00010000:2.0:1788744458.312822:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312834:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=530s v=(0 0) 00010000:00010000:2.0:1788744458.312839:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744458.312846:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.312859:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788744458.368208:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1788744458.368389:0:15004:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1788744458.368418:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368454:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368464:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368472:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744458.368477:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368487:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368508:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.368515:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95cce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744458.368905:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+6:2354:x1875634047546368:12345-192.168.204.56@tcp:4:dd.0 Request processed in 56127us (217675us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788744458.368924:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 1 00000100:00100000:3.0:1788744458.368967:0:15004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 2 00000100:00100000:3.0:1788744458.368980:0:15004:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047546624:12345-192.168.204.56@tcp:4:dd.0 00002000:00010000:3.0:1788744458.369025:0:15004:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9e1309, atime: 0x6a9e1308, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1788744458.369039:0:15004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.369052:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788744458.369057:0:15004:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744458.369064:0:15004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.369078:0:15004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744458.438622:0:15004:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788744458.438634:0:15004:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788744458.438654:0:15004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438668:0:15004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438678:0:15004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438686:0:15004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744458.438691:0:15004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438701:0:15004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438741:0:15004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.438748:0:15004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744458.438864:0:15004:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2354:x1875634047546624:12345-192.168.204.56@tcp:4:dd.0 Request processed in 69883us (287577us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788744458.438875:0:15004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 2 00000001:00080000:1.0:1788744458.439712:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:2.0:1788744458.453912:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:3.0:1788744458.454005:0:15002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047546880 00000100:00100000:3.0:1788744458.454015:0:15002:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047546880 00000100:00100000:3.0:1788744458.454086:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:3.0:1788744458.454104:0:15002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047546880:12345-192.168.204.56@tcp:4:dd.0 00002000:00010000:3.0:1788744458.454156:0:15002:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9e1309, atime: 0x6a9e1308, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788744458.454165:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.454183:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=530s v=(0 0) 00010000:00010000:3.0:1788744458.454188:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744458.454196:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.454209:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744458.457703:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744458.457929:0:15004:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788744458.457941:0:15004:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788744458.459644:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547008 00000100:00100000:3.0:1788744458.459663:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547008 00000100:00100000:2.0:1788744458.464682:0:16540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 4 00000100:00100000:2.0:1788744458.464704:0:16540:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2354:x1875634047547008:12345-192.168.204.56@tcp:4:dd.0 00010000:00010000:2.0:1788744458.464748:0:16540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.464765:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744458.464777:0:16540:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788744458.464784:0:16540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788744458.464800:0:16540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744458.476385:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744458.476594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744458.476648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:0.0:1788744458.476675:0:15004:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788744458.476685:0:15004:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788744458.476831:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547264 00000100:00100000:0.0:1788744458.476845:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547264 00000100:00100000:0.0:1788744458.476912:0:15004:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788744458.476918:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547136 00000100:00100000:0.0:1788744458.476922:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547136 00000100:00100000:0.0:1788744458.476956:0:15004:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788744458.476963:0:15004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547392 00000100:00100000:0.0:1788744458.476966:0:15004:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547392 00000100:00100000:0.0:1788744458.477419:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:0.0:1788744458.477433:0:16541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:485aaa4b-4c98-4e00-ad7e-2419ecd72724+13:2353:x1875634047547264:12345-192.168.204.56@tcp:4:dd.0 00010000:00010000:0.0:1788744458.477476:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.477501:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744458.477506:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744458.477514:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.477531:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744458.531529:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1788744458.533241:0:15002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1788744458.533259:0:15002:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788744457 -> 1788744458 00002000:00010000:3.0:1788744458.533262:0:15002:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788744458 00002000:00010000:3.0:1788744458.533264:0:15002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788744458.533282:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533295:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533305:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533312:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca400 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744458.533317:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533326:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533360:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.533388:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fbf4df4/0x7cd2bfd5e1b95cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744458.538059:0:15002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+15:2354:x1875634047546880:12345-192.168.204.56@tcp:4:dd.0 Request processed in 83948us (84150us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788744458.538070:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 3 00000100:00100000:3.0:1788744458.538122:0:15002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 6 00000100:00100000:3.0:1788744458.538136:0:15002:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+14:2354:x1875634047547136:12345-192.168.204.56@tcp:4:dd.0 00010000:00010000:3.0:1788744458.538184:0:15002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.538204:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744458.538209:0:15002:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788744458.538215:0:15002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.538231:0:15002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788744458.581785:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1788744458.581887:0:16541:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788744458.581907:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.581922:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.581934:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.581964:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa76200 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744458.581969:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.581979:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.582001:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.582009:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001cea28c/0x7cd2bfd5e1b95cea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744458.582122:0:16541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:485aaa4b-4c98-4e00-ad7e-2419ecd72724+12:2353:x1875634047547264:12345-192.168.204.56@tcp:4:dd.0 Request processed in 104688us (105744us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788744458.582132:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 5 00000100:00100000:0.0:1788744458.582169:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 7 00000100:00100000:0.0:1788744458.582182:0:16541:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:2354:x1875634047547392:12345-192.168.204.56@tcp:4:dd.0 00010000:00010000:0.0:1788744458.582223:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.582238:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744458.582253:0:16541:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788744458.582259:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.582286:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788744458.590614:0:16540:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788744458.590641:0:16540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590657:0:16540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590690:0:16540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590699:0:16540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9409c24df600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:3.0:1788744458.590703:0:16540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590714:0:16540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590738:0:16540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788744458.590747:0:16540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053118158/0x7cd2bfd5e1b95ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788744458.590854:0:16540:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:485aaa4b-4c98-4e00-ad7e-2419ecd72724+11:2354:x1875634047547008:12345-192.168.204.56@tcp:4:dd.0 Request processed in 126150us (133154us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788744458.590866:0:16540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 4 00000001:00080000:0.0:1788744458.638213:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1788744458.642943:0:15002:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788744458.642957:0:15002:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788744458.642979:0:15002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.642995:0:15002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.643004:0:15002:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.643012:0:15002:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940ac29ca600 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744458.643018:0:15002:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.643028:0:15002:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.643049:0:15002:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.643057:0:15002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265c331b/0x7cd2bfd5e1b95cf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744458.643178:0:15002:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940aff8ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:485aaa4b-4c98-4e00-ad7e-2419ecd72724+9:2354:x1875634047547136:12345-192.168.204.56@tcp:4:dd.0 Request processed in 105041us (166577us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788744458.643190:0:15002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 6 00010000:00010000:0.0:1788744458.671069:0:16541:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671089:0:16541:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671099:0:16541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671108:0:16541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff940afaa77000 already unused, calling callback (ffffffffc1485940) 00010000:00010000:0.0:1788744458.671112:0:16541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671121:0:16541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671141:0:16541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788744458.671148:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b43ac332/0x7cd2bfd5e1b95cf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788744458.671278:0:16541:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940afa5cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:485aaa4b-4c98-4e00-ad7e-2419ecd72724+7:2354:x1875634047547392:12345-192.168.204.56@tcp:4:dd.0 Request processed in 89095us (194623us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788744458.671289:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 7 00000001:00080000:0.0:1788744458.671344:0:7639:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1788744459.292468:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788744460.218828:0:16580:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1788744460.270878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.270995:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547648 00000100:00100000:2.0:1788744460.271009:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547648 00000100:00100000:2.0:1788744460.271073:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00100000:2.0:1788744460.271086:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940af6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+20:2354:x1875634047547648:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.271173:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940af6e2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:485aaa4b-4c98-4e00-ad7e-2419ecd72724+20:2354:x1875634047547648:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 90us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.271182:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 30 00000100:00080000:1.0:1788744460.271768:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788744460.278068:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278128:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278155:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278183:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278224:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.56@tcp (source: 12345-192.168.204.56@tcp) 00000100:00100000:2.0:1788744460.278282:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047548032 00000100:00100000:2.0:1788744460.278293:0:15478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047548032 00000100:00100000:2.0:1788744460.278383:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:2.0:1788744460.278394:0:15478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+6:2353:x1875634047548032:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.279047:0:15478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c7cc926b-941e-4823-a2f7-075948338613+6:2353:x1875634047548032:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 650us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.279057:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 31 00000100:00100000:2.0:1788744460.279099:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547776 00000100:00100000:2.0:1788744460.279104:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547776 00000100:00100000:2.0:1788744460.279125:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047548288 00000100:00100000:2.0:1788744460.279127:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047548288 00000100:00100000:2.0:1788744460.279139:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547904 00000100:00100000:2.0:1788744460.279141:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547904 00000100:00100000:2.0:1788744460.279152:0:14998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047548160 00000100:00100000:2.0:1788744460.279154:0:14998:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047548160 00000100:00100000:2.0:1788744460.279170:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:2.0:1788744460.279177:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047547776:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.279208:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2353:x1875634047547776:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 31us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.279227:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 17 00000100:00100000:2.0:1788744460.279240:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744460.279246:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047548288:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.279271:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2353:x1875634047548288:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 25us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.279276:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 18 00000100:00100000:2.0:1788744460.279287:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:2.0:1788744460.279293:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047547904:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.279386:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:485aaa4b-4c98-4e00-ad7e-2419ecd72724+5:2354:x1875634047547904:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 93us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.279393:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 19 00000100:00100000:2.0:1788744460.279406:0:14998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:2.0:1788744460.279413:0:14998:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff940ace37a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047548160:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:2.0:1788744460.279437:0:14998:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff940ace37a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c7cc926b-941e-4823-a2f7-075948338613+5:2354:x1875634047548160:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 25us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788744460.279451:0:14998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 20 00000100:00100000:3.0:1788744460.279792:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875634047547520 00000100:00100000:3.0:1788744460.279810:0:14304:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875634047547520 00000100:00100000:3.0:1788744460.279857:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00100000:3.0:1788744460.279866:0:14304:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9409c12dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047547520:12345-192.168.204.56@tcp:400:kworker.0 00000100:00100000:3.0:1788744460.279894:0:14304:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9409c12dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d9d4cdde-e6b8-4c5c-b056-f647979e858e+13:2353:x1875634047547520:12345-192.168.204.56@tcp:400:kworker.0 Request processed in 30us (1838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788744460.279907:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.56@tcp, seq: 122 00000100:00080000:2.0:1788744460.282837:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788744460.282848:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788744460.282852:0:14307:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788744460.321812:0:14300:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788744461.346187:0:14299:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29766 lines, 29766 kept, 0 dropped, 0 bad.